Log In Sign Up

onepager.com
robots.txt

Robots Exclusion Standard data for onepager.com

Resource Scan

Scan Details

Site Domain onepager.com
Base Domain onepager.com
Scan Status Ok
Last Scan2026-01-01T04:30:12+00:00
Next Scan 2026-01-31T04:30:12+00:00

Last Scan

Scanned2026-01-01T04:30:12+00:00
URL https://onepager.com/robots.txt
Redirect https://www.onepager.com/robots.txt
Redirect Domain www.onepager.com
Redirect Base onepager.com
Domain IPs 104.26.12.10, 104.26.13.10, 172.67.70.82, 2606:4700:20::681a:c0a, 2606:4700:20::681a:d0a, 2606:4700:20::ac43:4652
Redirect IPs 104.26.12.10, 104.26.13.10, 172.67.70.82, 2606:4700:20::681a:c0a, 2606:4700:20::681a:d0a, 2606:4700:20::ac43:4652
Response IP 104.26.12.10
Found Yes
Hash 8a7473270383d6dc7a36526e873d5f31d25f3222cc7e4bcc4c8fb938396a40a8
SimHash 6b1a9c33ceb0

Groups

thinkbot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot-media

Rule Path
Disallow /about/case-studies/*.pdf

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.onepager.com/sitemap.xml
Back to top

Comments

  • Block all PDF case studies, but allow the rest of the case study folder to be indexed.
Back to top