Log In Sign Up

tomschooloflife.com
robots.txt

Robots Exclusion Standard data for tomschooloflife.com

Resource Scan

Scan Details

Site Domain tomschooloflife.com
Base Domain tomschooloflife.com
Scan Status Ok
Last Scan2024-07-02T02:35:03+00:00
Next Scan 2024-07-16T02:35:03+00:00

Last Scan

Scanned2024-07-02T02:35:03+00:00
URL https://tomschooloflife.com/robots.txt
Domain IPs 141.193.213.10, 141.193.213.11
Response IP 141.193.213.10
Found Yes
Hash 9b576cf26299d1d5661018b40a02bd02db2d9a7fceb382dbdb34ed26ae7cda22
SimHash 1154777bc741

Groups

mozilla/5.0 (compatible; mj12bot/v1.4.8; http://mj12bot.com/)

Rule Path
Disallow /

mozilla/5.0 (windows nt 10.0; win64; x64) applewebkit/537.36 (khtml, like gecko) chrome/109.0.0.0 safari/537.36

Rule Path
Disallow /

mozilla/5.0 (compatible; ahrefsbot/7.0; +http://ahrefs.com/robot/)

Rule Path
Disallow /

mozilla/5.0 (compatible; awariobot/1.0; +https://awario.com/bots.html)

Rule Path
Disallow /

mozilla/5.0 (windows nt 10.0; win64; x64) applewebkit/537.36 (khtml, like gecko) chrome/109.0.0.0 safari/537.36 edg/109.0.1518.70

Rule Path
Disallow /

mozilla/5.0 (x11; linux x86_64) applewebkit/537.36 (khtml, like gecko) chrome/61.0.3163.79 safari/537.36

Rule Path
Disallow /

mozilla/5.0 (x11; u; linux i686; fi-fi; rv:1.9.0.13) gecko/2009080315 linux mint/6 (felicia) firefox/3.0.13

Rule Path
Disallow /

mozilla/5.0 (windows nt 10.0; win64; x64; rv:109.0) gecko/20100101 firefox/109.0

Rule Path
Disallow /

mozilla/5.0 (macintosh; intel mac os x 10_15_5) applewebkit/605.1.15 (khtml, like gecko) version/13.1.1 safari/605.1.15 (applebot/0.1; +http://www.apple.com/go/applebot)

Rule Path
Disallow /

mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html)

Rule Path
Disallow /

mozilla/5.0 (linux; android 6.0.1; nexus 5x build/mmb29p) applewebkit/537.36 (khtml, like gecko) chrome/109.0.5414.101 mobile safari/537.36 (compatible; googlebot/2.1; +http://www.google.com/bot.html)

Rule Path
Disallow /

duckduckbot/1.1; (+http://duckduckgo.com/duckduckbot.html)

Rule Path
Disallow /

mozilla/5.0 applewebkit/537.36 (khtml, like gecko; compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) chrome/103.0.5060.134 safari/537.36

Rule Path
Disallow /

mozilla/5.0 (iphone; cpu iphone os 16_2 like mac os x) applewebkit/605.1.15 (khtml, like gecko) version/16.2 mobile/15e148 safari/604.1

Rule Path
Disallow /

node/rssfeedemitter (https://github.com/filipedeschamps/rss-feed-emitter)

Rule Path
Disallow /

mozilla/5.0 (macintosh; intel mac os x 10_15_7) applewebkit/605.1.15 (khtml, like gecko) version/16.3 safari/605.1.15

Rule Path
Disallow /

mozilla/5.0 (linux; android 7.0;) applewebkit/537.36 (khtml, like gecko) mobile safari/537.36 (compatible; petalbot;+https://webmaster.petalsearch.com/site/petalbot)

Rule Path
Disallow /
Back to top