gravityautossandysprings.com
robots.txt

Robots Exclusion Standard data for gravityautossandysprings.com

Resource Scan

Scan Details

Site Domain gravityautossandysprings.com
Base Domain gravityautossandysprings.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-13T05:59:20+00:00
Next Scan 2025-10-11T05:59:20+00:00

Last Successful Scan

Scanned2024-11-23T01:08:26+00:00
URL https://gravityautossandysprings.com/robots.txt
Redirect https://www.gravityautossandysprings.com/robots.txt
Redirect Domain www.gravityautossandysprings.com
Redirect Base gravityautossandysprings.com
Domain IPs 104.21.44.202, 172.67.203.171
Redirect IPs 104.21.44.202, 172.67.203.171
Response IP 172.67.203.171
Found Yes
Hash 5d07671c31ee731310e0d65673f5701d3d75b650e1369bed4626c2165c632e6c
SimHash 6f3d1865e7d3

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /galleria_images_staging/
Disallow /includes/
Disallow /tmp/
Disallow /windowsticker/

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /galleria_images_staging/
Disallow /includes/
Disallow /tmp/
Disallow /windowsticker/

Other Records

Field Value
sitemap https://www.gravityautossandysprings.com/sitemap.xml