spacelaunchnow.app
robots.txt

Robots Exclusion Standard data for spacelaunchnow.app

Resource Scan

Scan Details

Site Domain spacelaunchnow.app
Base Domain spacelaunchnow.app
Scan Status Ok
Last Scan2025-11-09T14:36:09+00:00
Next Scan 2025-11-16T14:36:09+00:00

Last Scan

Scanned2025-11-09T14:36:09+00:00
URL https://spacelaunchnow.app/robots.txt
Domain IPs 104.21.22.139, 172.67.205.29, 2606:4700:3032::6815:168b, 2606:4700:3034::ac43:cd1d
Response IP 172.67.205.29
Found Yes
Hash 56c3109640c4fb80f3ad678c035284e456a9191c82611a366d0be36dff1f2325
SimHash 6144c353ccb4

Groups

googlebot

Rule Path
Allow /next/*
Allow /launch/*
Allow /news/*
Allow /comments/*
Allow /ads.txt
Allow /launch/upcoming/spacex
Allow /launch/upcoming/florida
Allow /launch/upcoming/vandenberg
Allow /astronaut/*
Allow /vehicle/*
Allow /events/*
Allow /.well-known/assetlinks.json
Allow /
Allow /starship/
Disallow /v1/*
Disallow /2.0.0/*
Disallow /3.0.0/*
Disallow /3.1.0/*
Disallow /3.2.0/*
Disallow /api/*

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /next/*
Allow /launch/*
Allow /news/*
Allow /comments/*
Allow /ads.txt
Allow /launch/upcoming/spacex
Allow /launch/upcoming/florida
Allow /launch/upcoming/vandenberg
Allow /astronaut/*
Allow /vehicle/*
Allow /events/*
Allow /.well-known/assetlinks.json
Allow /starship/
Disallow /v1/*
Disallow /2.0.0/*
Disallow /3.0.0/*
Disallow /3.1.0/*
Disallow /3.2.0/*
Disallow /api/*

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://spacelaunchnow.app/sitemap.xml/

Warnings

  • `host` is not a known field.