gigbot.xyz
robots.txt

Robots Exclusion Standard data for gigbot.xyz

Resource Scan

Scan Details

Site Domain gigbot.xyz
Base Domain gigbot.xyz
Scan Status Ok
Last Scan2025-10-16T07:59:49+00:00
Next Scan 2025-11-15T07:59:49+00:00

Last Scan

Scanned2025-10-16T07:59:49+00:00
URL https://gigbot.xyz/robots.txt
Redirect https://www.gigbot.xyz/robots.txt
Redirect Domain www.gigbot.xyz
Redirect Base gigbot.xyz
Domain IPs 104.21.72.6, 172.67.173.100, 2606:4700:3032::6815:4806, 2606:4700:3035::ac43:ad64
Redirect IPs 104.21.72.6, 172.67.173.100, 2606:4700:3032::6815:4806, 2606:4700:3035::ac43:ad64
Response IP 172.67.173.100
Found Yes
Hash 843761504bc9875d036bbd51e79fb8d5d86a69ace8c67eaee51e2ba1e48ad9c7
SimHash 4908c852c733

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://gigbot.xyz/sitemap.xml