wcgazette.com
robots.txt

Robots Exclusion Standard data for wcgazette.com

Resource Scan

Scan Details

Site Domain wcgazette.com
Base Domain wcgazette.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-06T15:04:39+00:00
Next Scan 2024-11-05T15:04:39+00:00

Last Successful Scan

Scanned2024-07-09T13:51:12+00:00
URL https://wcgazette.com/robots.txt
Redirect https://www.wcgazette.com/robots.txt
Redirect Domain www.wcgazette.com
Redirect Base wcgazette.com
Domain IPs 50.112.150.139
Redirect IPs 50.112.150.139
Response IP 50.112.150.139
Found Yes
Hash 5dfcdb9a1ac37f68518c2ec0e677c3ddc0e83c3fdb8b0bba4fa41c1d87b76a26
SimHash 222f5de126d1

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ezoicbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

cloudflare-alwaysonline

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

facebookexternalhit

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot-udiscovery

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandeximages

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.wcgazette.com/sitemap_index.xml