arbgit.com
robots.txt

Robots Exclusion Standard data for arbgit.com

Resource Scan

Scan Details

Site Domain arbgit.com
Base Domain arbgit.com
Scan Status Ok
Last Scan2025-08-31T04:42:40+00:00
Next Scan 2025-09-07T04:42:40+00:00

Last Scan

Scanned2025-08-31T04:42:40+00:00
URL https://arbgit.com/robots.txt
Redirect https://www.arbgit.com/robots.txt
Redirect Domain www.arbgit.com
Redirect Base arbgit.com
Domain IPs 104.21.14.192, 172.67.160.45, 2606:4700:3032::ac43:a02d, 2606:4700:3036::6815:ec0
Redirect IPs 104.21.14.192, 172.67.160.45, 2606:4700:3032::ac43:a02d, 2606:4700:3036::6815:ec0
Response IP 104.21.14.192
Found Yes
Hash 0b52ba75779b394f0f655fc4ea3ea97e13e8dc976d66077ff6045b7f9fc63333
SimHash 6b44d1504e11

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /
Allow /ads.txt

Other Records

Field Value
sitemap https://www.arbgit.com/sitemap.xml