pacermonitor.com
robots.txt

Robots Exclusion Standard data for pacermonitor.com

Resource Scan

Scan Details

Site Domain pacermonitor.com
Base Domain pacermonitor.com
Scan Status Ok
Last Scan2024-05-29T11:25:45+00:00
Next Scan 2024-06-28T11:25:45+00:00

Last Scan

Scanned2024-05-29T11:25:45+00:00
URL https://pacermonitor.com/robots.txt
Domain IPs 18.67.181.46, 18.67.181.50, 18.67.181.77, 18.67.181.87
Response IP 13.33.30.101
Found Yes
Hash e194fd0e76fa4b5124b0d542967f88aa7680e283531d2b43334086606b4dd675
SimHash 984d9809fa92

Groups

mj12bot

Rule Path
Disallow /

linkdexbot/2.0

Rule Path
Disallow /

linkdexbot/2.1

Rule Path
Disallow /

linkdexbot/2.2

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /register
Disallow /team/register
Disallow /fulcrum_sso
Disallow /signup
Disallow /linkedin/
Disallow /rss/
Disallow /public/document/
Disallow /admin-panel/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /recaptcha