A MAP FOR BUILDING ON PRIOR WORK
Start from
what exists.
A useful library should change what we build next. Follow a question to the evidence, the available tools and an experiment worth checking.
Updated 2026-10-25 · Editorial recommendations, not validated integrations. Each linked note states exactly what was reviewed.
PATH 01
Choose the first animal
Where can we collect useful observations responsibly?
Welcome every animal in the app; validate one species and one observable question first.
- Parrot owners can contribute; species still matter · Full main-text review and metadata-only dataset/privacy assessment
- When companion parrots use names: what a survey can and cannot show · Targeted primary-source review
- Wild parrot duet structure: sequence patterns, not decoded meaning · Targeted primary article, dataset metadata and reuse-rights review
- Macaw calls change with age and population. That is not a translation. · Targeted publisher abstract and dataset-metadata review; full methods not reviewed
- Budgerigar vocal signatures: caller identity, not call meaning · Full article methods and results reviewed; dataset remains a one-file exploratory sample
- Parrotlet babbling is vocal development, not call translation · Targeted paper and dataset-lead review
- What bark classification can tell us · Full paper methods reviewed
- Cats: useful labels, limited reuse · Selected evidence reviewed
- Pig calls: inspect what the labels actually mean · Selected evidence reviewed
- Frog choruses: several callers, one recording · Selected evidence reviewed
- Phones can record wildlife, but they are not interchangeable sensors · Selected full-text methods, results, discussion, data-availability and rights review
Confirm access to several households with the same parrot species; compare annotation feasibility before committing to a pilot.
Budgerigars are provisional. No recruited participants, expert sign-off, recording uploads or translation model are implied.
PATH 02
Capture useful context
What should people record and label?
Reuse annotation workflows and independent behavior labels. Make unknowns explicit.
- Bat calls: context comes from observation · Selected methods reviewed
- Fruit-bat calls and context: a rich dataset, not a translation key · Targeted primary literature, dataset and rights review
- DAS: build on an existing annotation workflow · Documentation reviewed
- Start with tools researchers already use · Documentation checked
- Monk parakeet voiceprints test caller identity, not meaning · Targeted study and dataset-fit review
- Parrot social ties track call variation, not call meaning · Targeted article, deposit-metadata and pinned-repository review; metadata only
A synthetic file-exchange check, followed by a species-specific codebook and a reviewer-agreement exercise on approved data.
Real observations require an approved protocol, rights and consent. Public clips are not automatically research data.
PATH 03
Find sounds worth reviewing
How do we detect events without missing the quiet ones?
Compare existing detectors and encoders against our simple sound-level trigger. Keep a continuous, independently annotated test sample.
- animal2vec and MeerKAT: rare-call detection, not translation · Targeted peer-reviewed methods, results and rights review
- BirdNET: identification before interpretation · Documentation checked
- DAS: build on an existing annotation workflow · Documentation reviewed
- ANIMAL-SPOT: parrot call detection is not translation · Full main-article text and split methods reviewed; current repository access terms and API field semantics rechecked but not accepted; supplement, archive contents and specialist review remain open
- Strong bird-call labels can test detectors, not communication · Full preprint methods and evaluation; versioned dataset manifest and header-only metadata schema; pinned code review
- HyenaSET: a strong sound-event benchmark, not a communication test · Targeted preprint methods and results; official dataset version, file and terms metadata
- El Silencio helps detect sound across taxa, not decode meaning · Full overview paper, pinned annotation protocol and dataset/benchmark-fit review
- CEB can benchmark bird sound detection, not what a call means · Official Zenodo v1.1 record, version notes, schema and API file inventory reviewed; annotation rows, media and model remain uninspected
- A large forest-bird soundscape set can test detection, not conversation · Publisher abstract and rights notice, complete Zenodo v1/v2 metadata, and checksum-verified aggregate inspection of the four-file v2 metadata sample; no audio or annotation rows reviewed
Specify a rights-cleared continuous-audio evaluation with quiet intervals, event recall, false alarms per hour and review time. Use MeerKAT for metric/schema guidance only unless a separately scoped non-commercial reproduction passes its rights and animal/session split review.
Triggered clips alone cannot establish recall. MeerKAT's non-commercial data and checkpoint terms exclude them from the shared commercial-capable path; its public sample names do not expose animal/session groups. HyenaSET's dataset is CC BY-NC-SA 4.0, and its individual-held-out split is useful only as a methods reference until group files and location sensitivity are reviewed. Its reported animal2vec baseline pretrains on all available audio, so treat it as transductive unless clarified. Specialized recorders do not establish phone performance.
PATH 04
Reuse models, then test transfer
Can sound help predict independently observed context?
Start with frozen audio features and a small classifier. Compare against context-only, background and simple acoustic baselines.
- AVES and AVEX: reuse an encoder before training one · Abstract & documentation reviewed
- Perch: reusable representations of animal sound · Documentation checked
- NatureLM-audio: a bioacoustic model, not a nature translator · Targeted primary-paper and official model/data/code metadata review; no independent reproduction
- Speech models carry animal vocal patterns—not animal meanings · Full arXiv v1 HTML and version/license metadata reviewed; associated datasets, code and model assets not audited
- A zebra-finch classifier is a baseline, not a translator · Publisher article review plus current indexed claim check; metadata refreshed; no reproduction
- What bark classification can tell us · Full paper methods reviewed
- Barkopedia: context labels do not show call meaning · Official challenge and one task-specific dataset card reviewed; Task 6 card history checked only; metadata-only
- BIRB: test on the sounds your app will actually hear · Selected sections reviewed
- A benchmark is only as useful as its labels · Documentation checked
- A 2024 model study predicts bat context—with important limits · Paper, dataset, split-feasibility and reviewer-independence review
- Monk parakeet calls carry individual identity information · Targeted primary article, dataset metadata, and code-provenance review; no file acquisition or reproduction
- A shared bioacoustic dataset loader, with rights kept separate · Official repository overview and exact PyPI release metadata reviewed; integration and individual dataset rights not audited
- ANIMAL-SPOT: parrot call detection is not translation · Full main-article text and split methods reviewed; current repository access terms and API field semantics rechecked but not accepted; supplement, archive contents and specialist review remain open
- CoarseSoundNet: soundscape context, not animal language · Full preprint review and official code/model/dataset metadata inspection; no independent reproduction
- Strong bird-call labels can test detectors, not communication · Full preprint methods and evaluation; versioned dataset manifest and header-only metadata schema; pinned code review
- CowRumIA: a cattle-audio app and a test-set caution · Pinned GitHub README, LICENSE and training-script static review; official Zenodo v1 metadata review
- iNatSounds scales species recognition, not animal meaning · Targeted paper, pinned dataset README/terms, media-licensing guidance and implementation/model-release review; metadata only
- A large insect sound dataset can test species recognition—not what a call means · PubMed primary abstract, official Zenodo v1.1 description and file list, and author repository root/README reviewed; full article methods and annotation CSV contents not reviewed; no media, code or model acquired or run
- MooLogue separates cattle-call learning from live analysis · Targeted article and pinned-repository review; metadata-only, no reproduction
- BirdNET Live keeps bird identification on the phone · Official app documentation/privacy policy and pinned GitHub release reviewed; no app install, model execution or independent validation
Choose a rights-cleared, independently labeled task; pin every data and model component; and freeze animal/session/site holdouts before evaluating simple baselines.
The dog-bark paper predicts labels tied to induced stimuli; Barkopedia's reviewed context labels were initially inferred from video and its source recordings' rights remain unresolved; CowRumIA reuses its test partition in validation callbacks. Treat each as a methods comparator, not evidence of meaning or a ready training set. No Talk2Nature animal model has been trained or benchmarked; AutoResearch remains NOT READY. iNatSounds is a weakly labeled file-level species-classification/pretraining reference, not a context or meaning set; its download terms restrict use to non-commercial research/education and prohibit audio redistribution, so it is not admitted to the commercial-capable Talk2Nature path. MooLogue is a mobile-learning comparator only: its paper and pinned repository disagree about offline versus cloud behavior, and code/data rights remain unresolved. BirdNET Live v1.2.1 identifies bird species, not call meaning. Its MIT code and Apache-2.0 model licenses are distinct; developer privacy claims and optional third-party location services were reviewed from docs, not runtime-tested.
PATH 05
Know what would count as understanding
When does an association support a claim about meaning?
Study receiver behavior, matched comparisons and competing explanations. Distinguish companion parrots' learned human names from natural conspecific signals proposed as names; keep each critique connected to the original evidence.
- Japanese-tit call order: evidence and interpretations · Primary evidence and alternative theory reviewed
- Zebra finches categorize call types; translation remains a bigger question · Peer-reviewed article text and public release metadata reviewed; archive contents and analyses not reproduced
- The Wytham great-tit dataset maps song structure, not meaning · Primary 2024 dataset paper and 2025 full article/methods reviewed; author documentation, OSF API manifest and documented coordinate fields reviewed. On 2026-10-25, one 6,426-byte documentation file was fetched only to verify its current OSF SHA-256 and MD5; its text was not reviewed or redistributed. No audio archive acquisition or model reproduction.
- How great tits respond to a distant species’ mobbing calls · Publisher-indexed methods/results and institutional abstract reviewed; no article file, data, or independent specialist review
- Dupont's lark songs and calls: an annotated vocal-type dataset · Full publisher article, Zenodo concept-DOI redirect and version metadata, public-sector catalog, full CSIC README and archive HEAD metadata reviewed; archive and code bytes not inspected.
- Do animal calls function as names? A proposed test framework · Abstract and publisher-highlights review; full text was not accessible in this review
- When companion parrots use names: what a survey can and cannot show · Targeted primary-source review
- Wild parrot duet structure: sequence patterns, not decoded meaning · Targeted primary article, dataset metadata and reuse-rights review
- A parrot can imitate a call to address another bird. What the experiment shows. · Full-text methods and results review
- Elephant calls: pair promising findings with their critiques · Selected methods & critique notice reviewed
- Patterns inside sperm whale codas · Initial source note
- Learned buttons and receiver responses · Initial source note
- Playback can shape the call you measure · Selected methods and results reviewed
Ask a scientific reviewer to assess one bounded hypothesis and its controls before designing any intervention.
A caregiver report about a human-created name differs from evidence about natural conspecific calls. Neither an individual acoustic signature nor a receiver response alone establishes shared meaning. Public tools remain passive; no automated playback or general translation claim.
PATH 06
Connect sound, movement and other signals
Which measurements could reveal something audio alone misses?
Use separate evidence standards for animal behavior, plant physiology and fungal electrophysiology.
- Put the sound back into its scene · Initial source note
- A camera can decode a known bee signal—with calibration · Primary paper, pinned artifact metadata and separate system comparator reviewed
- Plants have channels beyond sound · Initial source note
- When another organism responds · Full-text methods, results and public review record reviewed; one checksum-pinned source table checked in aggregate
- Fungal electricity needs careful controls · Initial source note
- Fungal electrical signals travel; communication remains untested · Full-text methods and data-provenance review; no reproduction
- Fungal electrical activity: a sensor study, not a decoded language · Full primary article and dataset metadata review; supplement and files unreviewed
- Do fungi have a language? What electrical recordings show · Full preprint methods and 2025 review; critique abstract/selected sections; dataset metadata only
- Can trees talk through fungi? What mycorrhizal networks show · Targeted publisher-source review; not a systematic review
- Common endophyte networks: resource transfer is not communication · Full primary article and repository metadata reviewed; no artifact reproduction or independent specialist review
- Ice-crystal claims: why beautiful images need stronger tests · Targeted full-text methods review; not a systematic review
Start with an already-defined visual or acoustic signal and an independently measured outcome. Compare human review and simple baselines before proposing a phone feature; keep device feasibility and privacy gates explicit.
The honeybee camera study is a calibrated decoder for one known signal, not general gesture translation. Its linked code and ground-truth data have no located reuse license; no files were acquired. The phone-camera use case remains untested.
PATH 07
Design technology around the animal
What changes when an animal uses the interface directly?
Use species- and individual-aware interaction design, short optional sessions, and a reliable way to leave; test observable behavior rather than assuming engagement.
- What parrot touchscreen research can—and cannot—tell us · Full published article text reviewed
- Giving parrots a choice to connect · Methods reviewed
Compare animal-operated tablet tasks with parrot choice in video calls, then ask an animal-computer-interaction researcher to review any future animal-facing design before prototyping.
This evidence concerns touchscreen enrichment, not Talk2Nature’s human-operated passive recorder or a way to communicate meaning. This reading path does not add animal-directed features.
PATH 08
Align sound with observed behavior
Can an acoustic feature predict a behavior that was independently observed at the same time?
Treat overlap separation as an upstream preprocessing candidate, then evaluate caller attribution and independently observed context as separate tasks. Preserve unknown and mixed-source cases.
- BioCPPNet separates overlapping calls—it does not decode them · Primary paper method/results review and pinned implementation-repository review
- V33DA: a zebra-finch caller benchmark, not a translation model · Pinned dataset-card, code and sample metadata reviewed; media uninspected
- V33DA++ adds overlapping calls and context, not meaning · Pinned dataset-card and public code/split metadata reviewed; media uninspected
- Budgerigar vocal and social records are not event-aligned · Primary methods and dataset-fit review; files remain metadata-only
- Monk parakeet voiceprints test caller identity, not meaning · Targeted study and dataset-fit review
- Parrotlet babbling is vocal development, not call translation · Targeted paper and dataset-lead review
- MammAlps aligns animal sound with video-annotated behavior · Targeted paper, release and benchmark-fit review
- Fruit-bat calls and context: a rich dataset, not a translation key · Targeted primary literature, dataset and rights review
- Lilac-crowned Amazon calls vary with context; meaning remains a question · Full-text primary-source review
First establish rights and a source-resolved evaluation set. Compare known-source synthetic mixtures with and without separation, then test any downstream context claim on frozen animal/session groups with independent observation labels and appropriate baselines.
BioCPPNet reports validation on constructed mixtures and downstream caller identity; it does not validate natural phone recordings or receiver comprehension, and the reviewed code snapshot has no visible LICENSE. Bat-archive raw-audio rights and joins remain unresolved, and no source is admitted to the first Talk2Nature context benchmark.
PATH 09
Retrieve observable events without inventing meaning
Can a natural-language query find video clips whose reviewed behavior labels satisfy it?
Treat a prompt as a search interface over an explicit label schema. Evaluate perception, label provenance, prompt parsing and retrieval separately; do not infer vocal meaning from video labels.
- MammAlps aligns animal sound with video-annotated behavior · Targeted paper, release and benchmark-fit review
- Natural-language prompts can retrieve annotated wildlife videos · Targeted paper, benchmark, release and rights review
Compare the two MammAlps releases' modalities, splits and licenses, then write a leakage-safe retrieval protocol with held-out individuals or sites before considering a model run.
Prompting-MammAlps is video-only and CC BY-NC 4.0; its code rights are unresolved and its published day split is not verified animal-held-out. Neither MammAlps release establishes animal language or enters the first commercial-capable benchmark.
Keep this map growing
Suggest an original paper, official code repository, dataset or correction. Include the question it helps answer, what was actually reviewed and the reuse limits. We prioritize methods that could change the next experiment; full methods review and specialist review remain separate steps.
Contribute a source or correction ↗