Likeness Search Package

PreviousNext

Likeness search, indexing, and AI tag generation functionality

Overview

@zooly/likeness-search is a comprehensive package that provides likeness search capabilities, indexing functionality, and AI-powered tag generation from images and voice samples. It enables searching for accounts based on visual and audio likeness characteristics.

Package Details

  • Package Name: @zooly/likeness-search
  • Location: packages/likeness-search
  • Type: Search and indexing service

Key Features

  • Likeness Search: Search for accounts based on visual and audio characteristics
  • Indexing: Index account data for fast similarity searches
  • AI Tag Generation: Generate descriptive tags from images and voice samples
  • Vector Search: Fallback vector-based search capabilities

Core Functionality

Search Operations

  • searchLikeness - Search for multiple likeness matches
  • vectorFallbackSearch - Vector-based fallback search
  • formatSearchResults - Format search results for display

Indexing Operations

  • upsertToIndex - Add or update account data in the search index
  • removeFromIndex - Remove account data from the search index
  • indexingDaemon - Background daemon for processing indexing events
  • processIndexingEvent - Process individual indexing events

Tag Generation

  • generateTagsFromImage - Generate tags from images using AI
  • generateTagsFromVoice - Generate tags from voice samples using AI
  • aggregateAccountTags - Aggregate and normalize tags for vector search
  • triggerAITagGeneration - Trigger AI tag generation process

Voice Operations

  • validateAudioUrl - Validate audio URLs (rejects video platforms)
  • validateAudioContentType - Validate audio blob content types

Utilities

  • validateAudioUrl - Validate audio URLs
  • handleApiError - Error handling with retry logic
  • triggerSocialScraping - Trigger social media scraping
  • triggerDataCollection - Trigger data collection processes

Dependencies

  • @zooly/app-db - Database access layer
  • @zooly/types - Shared types
  • @zooly/util - Shared utilities
  • @zooly/util-srv - Server-side utilities (S3 operations)
  • @zooly/util-elevenlabs - ElevenLabs voice operations
  • @ai-sdk/google / @ai-sdk/openai - AI SDK providers
  • @aws-sdk/client-s3 - S3 operations
  • ai - AI SDK core
  • zod - Schema validation

Usage

This package is used by the main app to provide likeness search functionality. It handles the complex process of indexing account data, generating AI tags, and performing similarity searches based on visual and audio characteristics.