Crawler transparency

Onlooker Bot

Onlooker Bot is the automated browser used by ONLabs Onlooker to capture public website state for customer-authorized monitoring, external exposure inventory, and exposure-change detection.

User agent: on-labs-onlooker/1.0 (+https://on-labs.net/onlooker-bot)

Transparency URL: https://on-labs.net/onlooker-bot

Purpose

What the bot does

Onlooker Bot visits domains that customers add to Onlooker so the platform can observe page structure, scripts, linked assets, reachable HTTP and HTTPS endpoints, and other public signals that help identify unexpected changes or possible exposure.

Scope

What it collects

The bot records public HTTP and HTTPS request metadata, selected DOM details, technology fingerprints, screenshots, endpoint reachability, HTTP status, redirect chains, response banner headers, and TLS posture needed to support monitoring workflows. It does not attempt to log in, bypass access controls, or access non-public areas.

Exposure inventory

What exposure monitoring adds

Onlooker uses bot observations to build an inventory of internet-facing web exposure for each authorized domain, including protocol, URL, reachability, hosting provider, ASN, country, redirect behavior, and certificate posture.

Exposure alerts

When changes are flagged

Exposure snapshots are compared over time to highlight new public endpoints, service metadata changes, removed security headers, weakened TLS, hosting movement, or appearances on risky network providers.

Identification

How to identify it

Requests made through the automated browser include a user agent that points back to this page so site operators can understand the traffic source and purpose.

Network

Source IP placeholder

Source IP: TODO: add Onlooker Bot source IP address