gaib.ai
robots.txt

Robots Exclusion Standard data for gaib.ai

Resource Scan

Scan Details

Site Domain gaib.ai
Base Domain gaib.ai
Scan Status Ok
Last Scan2025-10-13T00:31:33+00:00
Next Scan 2025-11-12T00:31:33+00:00

Last Scan

Scanned2025-10-13T00:31:33+00:00
URL https://gaib.ai/robots.txt
Domain IPs 76.76.21.21
Response IP 76.76.21.21
Found Yes
Hash f87b69180b4507aca0e49cdf64f0e02ebba58d0cb6429caa094671c3d567009b
SimHash 284d591a0633

Groups

*

Rule Path
Allow /
Disallow /googled05168c0c3d9efd7.html
Disallow /googleeb4402f263565713.html

Other Records

Field Value
sitemap https://gaib.ai/sitemap.xml

Comments

  • Sitemap
  • Disallow crawling of private files