startuphustle.xyz
robots.txt

Robots Exclusion Standard data for startuphustle.xyz

Resource Scan

Scan Details

Site Domain startuphustle.xyz
Base Domain startuphustle.xyz
Scan Status Ok
Last Scan2025-05-05T10:43:23+00:00
Next Scan 2025-06-04T10:43:23+00:00

Last Scan

Scanned2025-05-05T10:43:23+00:00
URL https://startuphustle.xyz/robots.txt
Redirect https://www.startuphustlepodcast.com/robots.txt
Redirect Domain www.startuphustlepodcast.com
Redirect Base startuphustlepodcast.com
Domain IPs 104.21.51.177, 172.67.183.56, 2606:4700:3032::6815:33b1, 2606:4700:3035::ac43:b738
Redirect IPs 54.90.47.105
Response IP 54.90.47.105
Found Yes
Hash ab488e68dc17afc10ac2fa5612c564bf71c0d21fb7bfeeea1dbd2f4dbc1f9305
SimHash 671dd0a1ef91

Groups

googlebot
bingbot
slurp
duckduckbot
yandexbot

Rule Path
Allow /

amazonbot
mj12bot
petalbot
aspiegelbot
ahrefsbot
semrushbot
dotbot
mauibot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.startuphustlepodcast.com/sitemap.xml