Skip to main content
Smart Scan uses AI credits. Each image scan costs 1 AI credit. See Credits for details on usage and limits.
Smart Scan uses advanced AI vision to recognize multiple items from a single photo and automatically populate your helper’s data fields. Take a picture of your fridge, toolbox, wine collection, or parts bin — Peanuts identifies everything and adds it to your inventory in seconds.
Smart Scan identifying items from a photo

How It Works

Smart Scan is context-aware — it reads your helper’s name, description, and fields to understand exactly what to look for and how to categorize items.
1

Take a Photo

Tap the Smart Scan field and take a photo or upload an existing image
2

AI Analyzes

Gemini Vision AI identifies all visible items based on your helper’s context
3

Review Results

A dialog shows all detected items — edit, select, or deselect as needed
4

Confirm & Add

Selected items are bulk-added to your helper with all fields populated

Domain Intelligence

Smart Scan automatically adapts its recognition based on your helper’s domain. This ensures more accurate and relevant results.
  • Identifies food items, brands, and quantities
  • Notes visible expiry dates and freshness indicators
  • Recognizes packaging and portion sizes
Best for: Fridge contents, pantry inventory, meal prep ingredients
  • Identifies parts, tools, and equipment
  • Notes condition, brand names, and part numbers
  • Recognizes tool types and sizes
Best for: Tool shed inventory, spare parts, workshop equipment
  • Identifies medications, supplements, and health products
  • Notes dosages when visible
  • Recognizes packaging and form factors
Best for: Medication cabinet, supplement tracking, first aid kit
  • Identifies receipts, invoices, and documents
  • Extracts amounts, descriptions, and dates
  • Recognizes document types and key identifiers
Best for: Expense tracking, receipt logging, document organization
  • Identifies collectible items and memorabilia
  • Notes titles, editions, and visible details
  • Recognizes item conditions and unique features
Best for: Comic books, trading cards, vinyl records, wine bottles

Using Smart Scan

Taking a Good Photo

For best results, follow these tips:

Lighting

Use bright, even lighting. Avoid shadows and glare.

Angle

Photograph items straight-on so labels and text are readable.

Spacing

Spread items apart slightly so AI can distinguish each one.

Focus

Ensure the image is sharp and in focus, especially on labels.

The Scan Interface

Smart Scan upload area
The Smart Scan field appears with:
  • Camera icon — Tap to take a photo or upload
  • AI Scan badge — Indicates this is an AI-powered feature
  • Drag & drop zone — On desktop, drag images directly into the field

Review & Edit Dialog

After scanning, a dialog presents all detected items:
Smart Scan results dialog with items
FeatureDescription
Source thumbnailShows the scanned image for reference
Item checkboxesSelect/deselect items to include
Select all/noneBulk selection controls
Edit buttonExpand to edit any field value
Add buttonConfirm and add selected items
Tap the pencil icon on any item to expand its fields for editing before adding.

Field Mapping

Smart Scan intelligently maps extracted data to your helper’s fields:
Field TypeAI Extraction Behavior
TextExtracts names, descriptions, brands
NumberExtracts quantities, amounts, numeric values only
SelectMatches to the closest available option
DateExtracts dates in YYYY-MM-DD format
CheckboxReturns true/false based on presence
Image fields are not populated by Smart Scan — the scan replaces the need for individual photos.

Custom Scan Hints

For specialized use cases, helpers can include a scan hint that provides additional instructions to the AI.
"Identify wine bottles, read labels for name, vintage, and region"
Result: AI focuses on extracting wine-specific details from bottle labels.

Built-In Templates

Several templates come with Smart Scan pre-configured:

Mobile Experience

On mobile, tapping the Smart Scan field opens your device camera directly with the rear camera selected for optimal capture.
Smart Scan on mobile

Mobile camera capture for Smart Scan

Credit Usage

Each Smart Scan analysis uses 1 AI credit, regardless of how many items are found.
Credit is deducted after successful analysis, not when you cancel or the scan fails.
ActionCredit Cost
Successful scan1 credit
Cancelled before results0 credits
Failed scan (error)0 credits
Editing results dialog0 credits

Troubleshooting

Possible causes:
  • Image too dark or blurry
  • Items too close together
  • Labels not visible
Solutions:
  • Improve lighting conditions
  • Spread items apart
  • Angle camera to capture labels
  • Try a closer photo
Possible causes:
  • Ambiguous items in frame
  • Helper context doesn’t match content
Solutions:
  • Use the edit button to correct fields
  • Deselect incorrect items
  • Ensure you’re using the right helper for the content
Possible causes:
  • AI made a best-guess match to available options
  • Item doesn’t fit predefined categories
Solutions:
  • Expand the item and select the correct option
  • Consider adding more category options to your helper
Possible causes:
  • Image too large (>10MB)
  • Network connectivity issues
  • Insufficient credits
Solutions:
  • Use a smaller/compressed image
  • Check your internet connection
  • Check your credit balance

Best Practices

Batch Similar Items

Photograph groups of similar items together — the AI handles them efficiently.

Use Good Lighting

Natural daylight or bright indoor lighting gives the best recognition results.

Show Labels

Position items so brand names, labels, and text are visible to the camera.

Review Before Adding

Always review the results dialog — AI is helpful but not perfect!

Technical Details

  • JPEG / JPG
  • PNG
  • WebP
  • HEIC (converted automatically on iOS)
  • Maximum file size: 10MB
  • Recommended resolution: 1-4 megapixels
  • Images are processed at original resolution
Smart Scan uses Gemini 2.5 Flash vision model for fast, accurate item recognition.
  • Images are uploaded securely to Peanuts storage
  • AI processing happens via encrypted API
  • Images are associated with your account only
  • You control data retention in your account settings