mirror of
https://github.com/soconnor0919/hristudio.git
synced 2026-03-23 19:27:51 -04:00
docs: consolidate and archive documentation
- Move 30+ outdated docs to docs/_archive/ - Move obsolete root files to _archive/ - Update README.md (Better Auth, current features) - Update docs/README.md (new architecture diagram) - Update docs/quick-reference.md (consolidated) - Update docs/project-status.md (March 2026 state) - Update docs/nao6-quick-reference.md (14 actions, Docker services) - Update docs/implementation-guide.md (Better Auth, git submodule) - Update docs/proposal.tex (timeline updates) - Archive errors.txt, plugin_dump.json, test HTML files
This commit is contained in:
367
docs/_archive/wizard-interface-guide.md
Executable file
367
docs/_archive/wizard-interface-guide.md
Executable file
@@ -0,0 +1,367 @@
|
||||
# Wizard Interface Guide
|
||||
|
||||
## Overview
|
||||
|
||||
The HRIStudio wizard interface provides a comprehensive, real-time trial execution environment with a consolidated 3-panel design optimized for efficient experiment control and monitoring.
|
||||
|
||||
## Interface Layout
|
||||
|
||||
```
|
||||
┌─────────────────────────────────────────────────────────────────────────────┐
|
||||
│ Trial Execution Header │
|
||||
│ [Trial Name] - [Participant] - [Status] │
|
||||
└─────────────────────────────────────────────────────────────────────────────┘
|
||||
┌──────────────┬──────────────────────────────────────┬──────────────────────┐
|
||||
│ │ │ │
|
||||
│ Trial │ Execution Timeline │ Robot Control │
|
||||
│ Control │ │ & Status │
|
||||
│ │ │ │
|
||||
│ ┌──────────┐ │ ┌──┬──┬──┬──┬──┐ Step Progress │ 📷 Camera View │
|
||||
│ │ Start │ │ │✓ │✓ │● │ │ │ │ │
|
||||
│ │ Pause │ │ └──┴──┴──┴──┴──┘ │ Connection: ✓ │
|
||||
│ │ Next Step│ │ │ │
|
||||
│ │ Complete │ │ Current Step: "Greeting" │ Autonomous Life: ON │
|
||||
│ │ Abort │ │ ┌────────────────────────────────┐ │ │
|
||||
│ └──────────┘ │ │ Actions: │ │ Robot Actions: │
|
||||
│ │ │ • Say "Hello" [Run] │ │ ┌──────────────────┐ │
|
||||
│ Progress: │ │ • Wave Hand [Run] │ │ │ Quick Commands │ │
|
||||
│ Step 3/5 │ │ • Wait 2s [Run] │ │ └──────────────────┘ │
|
||||
│ │ └────────────────────────────────┘ │ │
|
||||
│ │ │ Movement Controls │
|
||||
│ │ │ Quick Actions │
|
||||
│ │ │ Status Monitoring │
|
||||
└──────────────┴──────────────────────────────────────┴──────────────────────┘
|
||||
```
|
||||
|
||||
## Panel Descriptions
|
||||
|
||||
### Left Panel: Trial Control
|
||||
|
||||
**Purpose**: Manage overall trial flow and progression
|
||||
|
||||
**Features:**
|
||||
- **Start Trial**: Begin experiment execution
|
||||
- **Pause/Resume**: Temporarily halt trial without aborting
|
||||
- **Next Step**: Manually advance to next step (when all actions complete)
|
||||
- **Complete Trial**: Mark trial as successfully completed
|
||||
- **Abort Trial**: Emergency stop with reason logging
|
||||
|
||||
**Progress Indicators:**
|
||||
- Current step number (e.g., "Step 3 of 5")
|
||||
- Overall trial status
|
||||
- Time elapsed
|
||||
|
||||
**Best Practices:**
|
||||
- Use Pause for participant breaks
|
||||
- Use Abort only for unrecoverable issues
|
||||
- Document abort reasons thoroughly
|
||||
|
||||
---
|
||||
|
||||
### Center Panel: Execution Timeline
|
||||
|
||||
**Purpose**: Visualize experiment flow and execute current step actions
|
||||
|
||||
#### Horizontal Step Progress Bar
|
||||
|
||||
**Features:**
|
||||
- **Visual Overview**: See all steps at a glance
|
||||
- **Step States**:
|
||||
- ✓ **Completed** (green checkmark, primary border)
|
||||
- ● **Current** (highlighted, ring effect)
|
||||
- ○ **Upcoming** (muted appearance)
|
||||
- **Click Navigation**: Jump to any step (unless read-only)
|
||||
- **Horizontal Scroll**: For experiments with many steps
|
||||
|
||||
**Step Card Elements:**
|
||||
- Step number or checkmark icon
|
||||
- Truncated step name (hover for full name)
|
||||
- Visual state indicators
|
||||
|
||||
#### Current Step View
|
||||
|
||||
**Features:**
|
||||
- **Step Header**: Name and description
|
||||
- **Action List**: Vertical timeline of actions
|
||||
- **Action States**:
|
||||
- Completed actions (checkmark)
|
||||
- Active action (highlighted, pulsing)
|
||||
- Pending actions (numbered)
|
||||
- **Action Controls**: Run, Skip, Mark Complete buttons
|
||||
- **Progress Tracking**: Auto-scrolls to active action
|
||||
|
||||
**Action Types:**
|
||||
- **Wizard Actions**: Manual tasks for the wizard
|
||||
- **Robot Actions**: Commands sent to the robot
|
||||
- **Control Flow**: Loops, branches, parallel execution
|
||||
- **Observations**: Data collection and recording
|
||||
|
||||
**Best Practices:**
|
||||
- Review step description before starting
|
||||
- Execute actions in order unless branching
|
||||
- Use Skip sparingly and document reasons
|
||||
- Verify robot action completion before proceeding
|
||||
|
||||
---
|
||||
|
||||
### Right Panel: Robot Control & Status
|
||||
|
||||
**Purpose**: Unified location for all robot-related controls and monitoring
|
||||
|
||||
#### Camera View
|
||||
- Live video feed from robot or environment
|
||||
- Multiple camera support (switchable)
|
||||
- Full-screen mode available
|
||||
|
||||
#### Connection Status
|
||||
- **ROS Bridge**: WebSocket connection state
|
||||
- **Robot Status**: Online/offline indicator
|
||||
- **Reconnect**: Manual reconnection button
|
||||
- **Auto-reconnect**: Automatic retry on disconnect
|
||||
|
||||
#### Autonomous Life Toggle
|
||||
- **Purpose**: Enable/disable robot's autonomous behaviors
|
||||
- **States**:
|
||||
- ON: Robot exhibits idle animations, breathing, awareness
|
||||
- OFF: Robot remains still, fully manual control
|
||||
- **Best Practice**: Turn OFF during precise interactions
|
||||
|
||||
#### Robot Actions Panel
|
||||
- **Quick Commands**: Pre-configured robot actions
|
||||
- **Parameter Controls**: Adjust action parameters
|
||||
- **Execution Status**: Real-time feedback
|
||||
- **Action History**: Recent commands log
|
||||
|
||||
#### Movement Controls
|
||||
- **Directional Pad**: Manual robot navigation
|
||||
- **Speed Control**: Adjust movement speed
|
||||
- **Safety Limits**: Collision detection and boundaries
|
||||
- **Emergency Stop**: Immediate halt
|
||||
|
||||
#### Quick Actions
|
||||
- **Text-to-Speech**: Send custom speech commands
|
||||
- **Preset Gestures**: Common robot gestures
|
||||
- **LED Control**: Change robot LED colors
|
||||
- **Posture Control**: Sit, stand, crouch commands
|
||||
|
||||
#### Status Monitoring
|
||||
- **Battery Level**: Remaining charge percentage
|
||||
- **Joint Status**: Motor temperatures and positions
|
||||
- **Sensor Data**: Ultrasonic, tactile, IMU readings
|
||||
- **Warnings**: Overheating, low battery, errors
|
||||
|
||||
**Best Practices:**
|
||||
- Monitor battery level throughout trial
|
||||
- Check connection status before robot actions
|
||||
- Use Emergency Stop for safety concerns
|
||||
- Document any robot malfunctions
|
||||
|
||||
---
|
||||
|
||||
## Workflow Guide
|
||||
|
||||
### Pre-Trial Setup
|
||||
|
||||
1. **Verify Robot Connection**
|
||||
- Check ROS Bridge status (green indicator)
|
||||
- Test robot responsiveness with quick action
|
||||
- Confirm camera feed is visible
|
||||
|
||||
2. **Review Experiment Protocol**
|
||||
- Scan horizontal step progress bar
|
||||
- Review first step's actions
|
||||
- Prepare any physical materials
|
||||
|
||||
3. **Configure Robot Settings** (Researchers/Admins only)
|
||||
- Click Settings icon in robot panel
|
||||
- Adjust speech, movement, connection parameters
|
||||
- Save configuration for this study
|
||||
|
||||
### During Trial Execution
|
||||
|
||||
1. **Start Trial**
|
||||
- Click "Start" in left panel
|
||||
- First step becomes active
|
||||
- First action highlights in timeline
|
||||
|
||||
2. **Execute Actions**
|
||||
- Follow action sequence in center panel
|
||||
- Use action controls (Run/Skip/Complete)
|
||||
- Monitor robot status in right panel
|
||||
- Document any deviations
|
||||
|
||||
3. **Navigate Steps**
|
||||
- Wait for "Complete Step" button after all actions
|
||||
- Click to advance to next step
|
||||
- Or click step in progress bar to jump
|
||||
|
||||
4. **Handle Issues**
|
||||
- **Participant Question**: Use Pause
|
||||
- **Robot Malfunction**: Check status panel, use Emergency Stop if needed
|
||||
- **Protocol Deviation**: Document in notes, continue or abort as appropriate
|
||||
|
||||
### Post-Trial Completion
|
||||
|
||||
1. **Complete Trial**
|
||||
- Click "Complete Trial" after final step
|
||||
- Confirm completion dialog
|
||||
- Trial marked as completed
|
||||
|
||||
2. **Review Data**
|
||||
- All actions logged with timestamps
|
||||
- Robot commands recorded
|
||||
- Sensor data captured
|
||||
- Video recordings saved
|
||||
|
||||
---
|
||||
|
||||
## Control Flow Features
|
||||
|
||||
### Loops
|
||||
|
||||
**Behavior:**
|
||||
- Loops execute their child actions repeatedly
|
||||
- **Implicit Approval**: Wizard automatically approves each iteration
|
||||
- **Manual Override**: Wizard can skip or abort loop
|
||||
- **Progress Tracking**: Shows current iteration (e.g., "2 of 5")
|
||||
|
||||
**Best Practices:**
|
||||
- Monitor participant engagement during loops
|
||||
- Use abort if participant shows distress
|
||||
- Document any skipped iterations
|
||||
|
||||
### Branches
|
||||
|
||||
**Behavior:**
|
||||
- Conditional execution based on criteria
|
||||
- Wizard selects branch path
|
||||
- Only selected branch actions execute
|
||||
- Other branches are skipped
|
||||
|
||||
**Best Practices:**
|
||||
- Review branch conditions before choosing
|
||||
- Document branch selection rationale
|
||||
- Ensure participant meets branch criteria
|
||||
|
||||
### Parallel Execution
|
||||
|
||||
**Behavior:**
|
||||
- Multiple actions execute simultaneously
|
||||
- All must complete before proceeding
|
||||
- Independent progress tracking
|
||||
|
||||
**Best Practices:**
|
||||
- Monitor all parallel actions
|
||||
- Be prepared for simultaneous robot and wizard tasks
|
||||
- Coordinate timing carefully
|
||||
|
||||
---
|
||||
|
||||
## Keyboard Shortcuts
|
||||
|
||||
| Shortcut | Action |
|
||||
|----------|--------|
|
||||
| `Space` | Start/Pause Trial |
|
||||
| `→` | Next Step |
|
||||
| `Esc` | Abort Trial (with confirmation) |
|
||||
| `R` | Run Current Action |
|
||||
| `S` | Skip Current Action |
|
||||
| `C` | Complete Current Action |
|
||||
| `E` | Emergency Stop Robot |
|
||||
|
||||
---
|
||||
|
||||
## Troubleshooting
|
||||
|
||||
### Robot Not Responding
|
||||
|
||||
1. Check ROS Bridge connection (right panel)
|
||||
2. Click Reconnect button
|
||||
3. Verify robot is powered on
|
||||
4. Check network connectivity
|
||||
5. Restart ROS Bridge if needed
|
||||
|
||||
### Camera Feed Not Showing
|
||||
|
||||
1. Verify camera is enabled in robot settings
|
||||
2. Check camera topic in ROS
|
||||
3. Refresh browser page
|
||||
4. Check camera hardware connection
|
||||
|
||||
### Actions Not Progressing
|
||||
|
||||
1. Verify action has completed
|
||||
2. Check for error messages
|
||||
3. Manually mark complete if stuck
|
||||
4. Document issue in trial notes
|
||||
|
||||
### Timeline Not Updating
|
||||
|
||||
1. Refresh browser page
|
||||
2. Check WebSocket connection
|
||||
3. Verify trial status is "in_progress"
|
||||
4. Contact administrator if persists
|
||||
|
||||
---
|
||||
|
||||
## Role-Specific Features
|
||||
|
||||
### Wizards
|
||||
- Full trial execution control
|
||||
- Action execution and skipping
|
||||
- Robot control (if permitted)
|
||||
- Real-time decision making
|
||||
|
||||
### Researchers
|
||||
- All wizard features
|
||||
- Robot settings configuration
|
||||
- Trial monitoring and oversight
|
||||
- Protocol deviation approval
|
||||
|
||||
### Observers
|
||||
- **Read-only access**
|
||||
- View trial progress
|
||||
- Monitor robot status
|
||||
- Add annotations (no control)
|
||||
|
||||
### Administrators
|
||||
- All features enabled
|
||||
- System configuration
|
||||
- Plugin management
|
||||
- Emergency overrides
|
||||
|
||||
---
|
||||
|
||||
## Best Practices Summary
|
||||
|
||||
✅ **Before Trial**
|
||||
- Verify all connections
|
||||
- Test robot responsiveness
|
||||
- Review protocol thoroughly
|
||||
|
||||
✅ **During Trial**
|
||||
- Follow action sequence
|
||||
- Monitor robot status continuously
|
||||
- Document deviations immediately
|
||||
- Use Pause for breaks, not Abort
|
||||
|
||||
✅ **After Trial**
|
||||
- Complete trial properly
|
||||
- Review captured data
|
||||
- Document any issues
|
||||
- Debrief with participant
|
||||
|
||||
❌ **Avoid**
|
||||
- Skipping actions without documentation
|
||||
- Ignoring robot warnings
|
||||
- Aborting trials unnecessarily
|
||||
- Deviating from protocol without approval
|
||||
|
||||
---
|
||||
|
||||
## Additional Resources
|
||||
|
||||
- **[Quick Reference](./quick-reference.md)** - Essential commands and shortcuts
|
||||
- **[Implementation Details](./implementation-details.md)** - Technical architecture
|
||||
- **[NAO6 Quick Reference](./nao6-quick-reference.md)** - Robot-specific commands
|
||||
- **[Troubleshooting Guide](./nao6-integration-complete-guide.md)** - Detailed problem resolution
|
||||
Reference in New Issue
Block a user