generatepress.com
robots.txt

Robots Exclusion Standard data for generatepress.com

Resource Scan

Scan Details

Site Domain generatepress.com
Base Domain generatepress.com
Scan Status Ok
Last Scan2025-09-17T16:29:30+00:00
Next Scan 2025-10-17T16:29:30+00:00

Last Scan

Scanned2025-09-17T16:29:30+00:00
URL https://generatepress.com/robots.txt
Domain IPs 104.16.150.108, 104.16.151.108, 2606:4700::6810:966c, 2606:4700::6810:976c
Response IP 104.16.150.108
Found Yes
Hash a4f58c7e0a6bde1b3da5c906c24f025149fd634ba4ee9327be6b095ed69345c2
SimHash 6514d80467c4

Groups

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10