battleroyalewithcheese.com
robots.txt

Robots Exclusion Standard data for battleroyalewithcheese.com

Resource Scan

Scan Details

Site Domain battleroyalewithcheese.com
Base Domain battleroyalewithcheese.com
Scan Status Ok
Last Scan2024-11-08T13:46:57+00:00
Next Scan 2024-11-15T13:46:57+00:00

Last Scan

Scanned2024-11-08T13:46:57+00:00
URL https://battleroyalewithcheese.com/robots.txt
Domain IPs 198.54.120.203
Response IP 198.54.120.203
Found Yes
Hash 2b403d8d40f6776cf181dbd286112fd51e49d644a6eb82e5e80f998a49069550
SimHash e8805b14fbd0

Groups

scrapy

Rule Path
Allow /

twitterbot

Rule Path
Disallow *
Allow /wp-content/uploads/*

*

Rule Path
Disallow /wp-admin*
Disallow /wp-login.php
Disallow /wp-content*
Disallow /*/feed
Disallow /*/trackback
Disallow /*?
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /category/
Disallow /page/
Disallow /pages/
Disallow /feed/
Disallow /feed
Disallow /tag/
Disallow /archives/