# Happonomy -- robots.txt (sub-spec 007 phase 2) # # The site had none, so crawlers had no sitemap reference and no guidance on the admin # surfaces. Those are already behind authentication (sub-spec 004), but there is no reason # to advertise them or to spend crawl budget on pages that return a login prompt. User-agent: * Allow: / # Admin surfaces -- authenticated, and of no value to a crawler. Disallow: /admin Disallow: /database-admin Disallow: /api/ # Payment returns. These are per-order URLs reached only after checkout; indexing them is # pointless and they carry an order id in the query string. Disallow: /payment-success Disallow: /payment-cancelled Disallow: /payment-test Sitemap: https://happonomy.org/sitemap.xml