edgecast.pirate101.com
robots.txt

Robots Exclusion Standard data for edgecast.pirate101.com

Resource Scan

Scan Details

Site Domain edgecast.pirate101.com
Base Domain pirate101.com
Scan Status Ok
Last Scan2024-06-05T01:36:55+00:00
Next Scan 2024-07-05T01:36:55+00:00

Last Scan

Scanned2024-06-05T01:36:55+00:00
URL https://edgecast.pirate101.com/robots.txt
Domain IPs 117.18.232.31
Response IP 117.18.232.31
Found Yes
Hash 480abbda6bc605610a4b7828171430a319d2d6785a7f20a5d554a51c217f6901
SimHash 481e9c4a7f90

Groups

*

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrush

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /forum$
Disallow /forum/
Allow /

googlebot

Rule Path
Disallow /site/home2/wizard101/page_ff80808119f271f50119f27d52ca000d
Disallow /home2/ravenwood/page_ff80808119f271f50119f27d52ca000d
Allow /

Other Records

Field Value
sitemap https://www.wizard101.com/sitemap.xml
sitemap https://www.pirate101.com/p101sitemap.xml
sitemap https://www.freekigames.com/kifreegamessitemap.xml