ponymag.com
robots.txt

Robots Exclusion Standard data for ponymag.com

Resource Scan

Scan Details

Site Domain ponymag.com
Base Domain ponymag.com
Scan Status Ok
Last Scan2026-01-04T20:58:34+00:00
Next Scan 2026-02-03T20:58:34+00:00

Last Scan

Scanned2026-01-04T20:58:34+00:00
URL https://ponymag.com/robots.txt
Domain IPs 104.26.2.87, 104.26.3.87, 172.67.74.169, 2606:4700:20::681a:257, 2606:4700:20::681a:357, 2606:4700:20::ac43:4aa9
Response IP 104.26.3.87
Found Yes
Hash 2502a2597091bd21b61532b6dfa3c2476be388e674cda3f220902b0066c94797
SimHash 407889098e83

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /shop/catalog/product_compare/
Disallow /shop/catalog/category/view/
Disallow /shop/catalog/product/view/
Disallow /shop/catalogsearch/
Disallow /shop/checkout/
Disallow /shop/control/
Disallow /shop/contacts/
Disallow /shop/customer/
Disallow /shop/customize/
Disallow /shop/newsletter/
Disallow /shop/poll/
Disallow /shop/review/
Disallow /shop/sendfriend/
Disallow /shop/tag/
Disallow /shop/wishlist/

mj12bot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

obot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10