Issues

• Tasks 4.5 Follow a OpenAL tutorial to find out how to test spatial audio

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#34 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 4.4: Test mappings (e.g., higher pitch = closer; sound shifts left/right depending on position).

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#33 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 4.3: Use a Python library (e.g., spaudiopy) to generate and play audio to airpods (?).

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#32 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 4.2: Convert depth → pitch or volume.

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#31 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 4.1: Convert object position (x, y) → stereo pan or 3D direction.

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#30 · Filter by author alisonsoong opened on Oct 5, 2025
  

• User Interaction and Testing: Test and refine system behavior with codesigners

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#29 · Filter by author alisonsoong opened on Oct 5, 2025

• Integration Layer: Combine all components into a unified app loop.

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#28 · Filter by author alisonsoong opened on Oct 5, 2025

• Spatial Audio Generation: Translate spatial and distance information into real-time audio cues.

  Feature

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#27 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 3.3: Smooth over time to prevent noisy jumps (i.e. moving window average), but still needs to reflect movement of the user toward the object.

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#26 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 3.2: Compute average depth value within the bounding box of the detected object.

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#25 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 3.1: Use monocular depth estimation (model?)

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#24 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Depth Estimation: Estimate distance between the user and the detected object.

  Feature

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#22 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 2.3: Output the object’s 2D bounding box (x, y, width, height).

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#21 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 2.2: Filter detections for relevant object classes (e.g., glass, bottle, chair).

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#20 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 1.3: (Optional) Add a toggle or voice command (“start search for bottle”) to trigger the system.

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#18 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 1.2: Make a nice webcam module that will incorporate depth later on

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#17 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Object Detection: Identify relevant objects in the camera’s field of view

  Feature

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#15 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 2.3: Output the object’s 2D bounding box (x, y, width, height).

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#14 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 2.2: Filter detections for relevant object classes (e.g., glass, bottle, chair).

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#13 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 2.1: Use a pretrained detection model (e.g., YOLO)

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#12 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Input & Setup: Capture the video feed

  Feature

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#11 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 1.3: (Optional) Add a toggle or voice command (“start search for bottle”) to trigger the system. Or we could just always detect one object for now, whatever is easy and a good example/is in COCO).

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#10 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 1.2: Make a nice webcam module that will incorporate depth later on

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#9 · Filter by author alisonsoong opened on Oct 5, 2025
  

• Task 1.1: Connect to the webcam (using OpenCV) and stream frames in real time.

  Task

  MIT-Assistive-Technology/MIT-Assistive-Technology.github.io#8 · Filter by author alisonsoong opened on Oct 5, 2025