Log In Sign Up

atonlines.com
robots.txt

Robots Exclusion Standard data for atonlines.com

Resource Scan

Scan Details

Site Domain atonlines.com
Base Domain atonlines.com
Scan Status Ok
Last Scan2024-06-24T18:59:35+00:00
Next Scan 2024-07-01T18:59:35+00:00

Last Scan

Scanned2024-06-24T18:59:35+00:00
URL https://atonlines.com/robots.txt
Domain IPs 27.254.153.47
Response IP 27.254.153.47
Found Yes
Hash 8207b8747559c0d0b1c7179f55cc484a48d97ec7bb2ad7917a5aa8fc57e3f282
SimHash 127616c04122

Groups

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduspider+(+http://www.baidu.com/search/spider.htm)

Rule Path
Disallow /

baiduspider/2.0;+http://www.baidu.com/search/spider.html

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

spider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandex.com

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefsbot/1.0

Rule Path
Disallow /

ahrefsbot/2.0

Rule Path
Disallow /

ahrefsbot/3.0

Rule Path
Disallow /

ahrefsbot/3.1

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/3.1; +http://ahrefs.com/robot/)

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sosospider+

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ezooms/1.0

Rule Path
Disallow /

mozilla/5.0 (compatible; ezooms/1.0; ezooms.bot@gmail.com)

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

googlebot

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /
Back to top

Comments

  • Baiduspider
  • Yandex
  • ahrefsbot
  • Sosospider
  • Ezooms
  • Sogou
  • Disallow Internet Archiver Wayback Machine
Back to top

Warnings

  • 6 invalid lines.
Back to top