novelgames.com
robots.txt
Robots Exclusion Standard data for novelgames.com
Resource Scan
Scan Details
Site Domain | novelgames.com |
Base Domain | novelgames.com |
Scan Status | Ok |
Last Scan | 2024-10-31T02:21:46+00:00 |
Next Scan | 2024-11-07T02:21:46+00:00 |
Last Scan
Scanned | 2024-10-31T02:21:46+00:00 |
URL | https://novelgames.com/robots.txt |
Redirect | https://www.novelgames.com/robots.txt |
Redirect Domain | www.novelgames.com |
Redirect Base | novelgames.com |
Domain IPs | 54.152.184.49 |
Redirect IPs | 2600:9000:271a:2200:0:e56c:86c0:93a1, 2600:9000:271a:4c00:0:e56c:86c0:93a1, 2600:9000:271a:4e00:0:e56c:86c0:93a1, 2600:9000:271a:5600:0:e56c:86c0:93a1, 2600:9000:271a:5c00:0:e56c:86c0:93a1, 2600:9000:271a:7c00:0:e56c:86c0:93a1, 2600:9000:271a:8800:0:e56c:86c0:93a1, 2600:9000:271a:aa00:0:e56c:86c0:93a1, 3.165.82.129, 3.165.82.2, 3.165.82.82, 3.165.82.93 |
Response IP | 3.165.82.93 |
Found | Yes |
Hash | d9d74edc31bd5119a40f63de38d20197bca2ca2057f5ed2b6ecc8e6565385b66 |
SimHash | 2c04496ee7d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /contactus/contact.php |
Disallow | /freenewsletters/subscribe.php |
Disallow | /tellyourfriends/tell.php |
Disallow | /requestagame/request.php |
Disallow | /comments/comments.php |
Disallow | /forums/postmessage.php |
Disallow | /forums/postpoll.php |
Disallow | /forums/putvote.php |
Disallow | /bugs/submit.php |
Disallow | /affiliates/join.php |
Disallow | /flashgames/highscores/processapply.php |
Disallow | /requestagame/request.php |
Other Records
Field | Value |
---|---|
sitemap | http://www.novelgames.com/en/sitemapindex.xml |