Crawler Audit
Agent transparency protocol
GPTBot/1.0ALLOWED
ClaudeBotALLOWED
CCBot (CommonCrawl)BLOCKED
PerplexityBotREADING
Citation Readiness
Score based on technical density and metadata freshness.
H1 HierarchyPass
Last-Modified HeadersMissing
82Citable
LLM Extraction Test
Simulating Claude-3.5-Sonnet perception
Actual Intent
“auth_token” is a 64-character hex string passed via Header.
LLM Hallucination
“auth_token” is base64 encoded and passed via URL param.
Remediation ReqdSchema.org injection recommended for this node.
Freshness Map
Visualizing documentation decay.
Stale (2yr+)Recent (24h)
output/llms.txt
# DevEngine Semantic Manifest
# Generated for AI Documentation Agents
Full Docs: https://devengine.ai/docs
API Reference: https://devengine.ai/api
{
"@context": "https://schema.org",
"@type": "SoftwareSourceCode",
"name": "DevEngine Agent Protocol",
"runtimePlatform": "Node.js",
"programmingLanguage": "TypeScript",
"abstract": "Automatic context generation for LLM ingestion."
}
## Core Modules
- /auth: JWT-based stateless identity
- /ingest: Multi-threaded crawler logic
- /vector: Metadata-pinned embeddings