rollpros.com
robots.txt

Robots Exclusion Standard data for rollpros.com

Resource Scan

Scan Details

Site Domain rollpros.com
Base Domain rollpros.com
Scan Status Ok
Last Scan2025-10-31T00:52:31+00:00
Next Scan 2025-11-30T00:52:31+00:00

Last Scan

Scanned2025-10-31T00:52:31+00:00
URL https://rollpros.com/robots.txt
Domain IPs 104.21.41.58, 172.67.189.118, 2606:4700:3035::6815:293a, 2606:4700:3037::ac43:bd76
Response IP 172.67.189.118
Found Yes
Hash fb69e5705a8301eaa64fc98148b1620361ed67818d9f5d377832f9a68db27186
SimHash 6f14d972ce31

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /*?pr_prod_strat=
Disallow /*?pr_rec_id=
Disallow /*?pr_rec_pid=
Disallow /*?pr_ref_pid=
Disallow /*?pr_seq=
Disallow /?page_id=
Disallow /cart
Disallow /cart.json
Disallow /cdn-cgi/
Disallow /wp-login.php
Disallow /author/
Disallow /*/feed/
Disallow /feed/
Disallow /comments/feed/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://rollpros.com/sitemap_index.xml

Warnings

  • 1 invalid line.
  • `host` is not a known field.