ge-tracker.com
robots.txt

Robots Exclusion Standard data for ge-tracker.com

Resource Scan

Scan Details

Site Domain ge-tracker.com
Base Domain ge-tracker.com
Scan Status Ok
Last Scan2025-09-20T12:47:42+00:00
Next Scan 2025-09-27T12:47:42+00:00

Last Scan

Scanned2025-09-20T12:47:42+00:00
URL https://ge-tracker.com/robots.txt
Redirect https://www.ge-tracker.com/robots.txt
Redirect Domain www.ge-tracker.com
Redirect Base ge-tracker.com
Domain IPs 104.26.4.109, 104.26.5.109, 172.67.74.130, 2606:4700:20::681a:46d, 2606:4700:20::681a:56d, 2606:4700:20::ac43:4a82
Redirect IPs 104.26.4.109, 104.26.5.109, 172.67.74.130, 2606:4700:20::681a:46d, 2606:4700:20::681a:56d, 2606:4700:20::ac43:4a82
Response IP 104.26.5.109
Found Yes
Hash a7ede9a94cdde449bb452a3da3dc90d49dc56f72aac29141d1121fd3d8d74b49
SimHash f00558104391

Groups

scrapy

Rule Path
Disallow /

*

Rule Path
Disallow /promotions/*

Other Records

Field Value
sitemap https://www.ge-tracker.com/sitemap.xml