theloopnewspaper.com
robots.txt

Robots Exclusion Standard data for theloopnewspaper.com

Resource Scan

Scan Details

Site Domain theloopnewspaper.com
Base Domain theloopnewspaper.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-26T23:52:03+00:00
Next Scan 2024-12-25T23:52:03+00:00

Last Successful Scan

Scanned2024-05-30T23:27:54+00:00
URL https://theloopnewspaper.com/robots.txt
Redirect https://www.theloopnewspaper.com/robots.txt
Redirect Domain www.theloopnewspaper.com
Redirect Base theloopnewspaper.com
Domain IPs 50.112.150.139
Redirect IPs 50.112.150.139
Response IP 50.112.150.139
Found Yes
Hash d4998e2bc24bf09327a805cee0a3582dbc27a55f234ebd9dea30fac891a6da49
SimHash 222fdde12611

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ezoicbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

cloudflare-alwaysonline

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot-udiscovery

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandeximages

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.theloopnewspaper.com/sitemap_index.xml