# Web Probe

Redirect trace, security headers, robots.txt, sitemap, TLS expiry, timing and meta tags for a URL you name.

## How to pay

Machine-payable over x402. USDC on: Base (eip155:8453), Solana (solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp), Polygon (eip155:137), Arbitrum One (eip155:42161).
No accounts. No API keys. No signup. The paying wallet is the account.

## Machine-readable

- OpenAPI: https://web-probe.x402tookit.com/openapi.json
- x402 manifest: https://web-probe.x402tookit.com/.well-known/x402
- Catalog (free): https://web-probe.x402tookit.com/catalog
- Health (free): https://web-probe.x402tookit.com/health
- Uptime (free): https://web-probe.x402tookit.com/uptime

## Endpoints (7)

### GET /http-timing — $0.02
Time one GET to a URL: DNS, connect, TLS, first byte and total ms, plus status, content type and size read.
Params: url: string
Example: https://web-probe.x402tookit.com/http-timing?url=https%3A%2F%2Fexample.com%2F

### GET /meta-tags — $0.02
Extract a page's title, description, canonical, og:/twitter: tags, lang, robots meta and h1 count (first 64 KB).
Params: url: string
Example: https://web-probe.x402tookit.com/meta-tags?url=https%3A%2F%2Fdocs.python.org%2F3%2Findex.html

### GET /redirect-trace — $0.02
Trace a URL's redirects hop by hop (up to 8): status and Location for each, final URL, loops and http downgrades.
Params: url: string
Example: https://web-probe.x402tookit.com/redirect-trace?url=https%3A%2F%2Fdocs.python.org%2F

### GET /robots-txt — $0.02
Parse a site's robots.txt (RFC 9309): groups, sitemaps, crawl-delay, and is path P allowed for agent A (longest match).
Params: url: string, agent?: string, path?: string
Example: https://web-probe.x402tookit.com/robots-txt?url=https%3A%2F%2Fwww.python.org%2F&agent=HTTrack&path=%2Fdownloads%2F

### GET /security-headers — $0.02
Grade a URL's browser security headers (HSTS, CSP, framing, nosniff, referrer, permissions) A to F and list missing ones.
Params: url: string
Example: https://web-probe.x402tookit.com/security-headers?url=https%3A%2F%2Fwww.python.org%2F

### GET /sitemap-check — $0.02
Fetch a sitemap.xml: urlset or index, URL count, lastmod range, sample URLs, host mismatches. Body capped at 1.5 MB.
Params: url: string
Example: https://web-probe.x402tookit.com/sitemap-check?url=https%3A%2F%2Fwww.sitemaps.org%2Fsitemap.xml

### GET /tls-expiry — $0.02
Read a host's live TLS certificate: issuer, subject, valid dates, days left, names (SANs), chain trust, protocol.
Params: host: string
Example: https://web-probe.x402tookit.com/tls-expiry?host=example.com

## Terms

Observations of one request made from our server at one moment, provided as is. Not a security audit, not a guarantee of how other clients or locations see the site.