arachnid-manga.fandom.com
robots.txt
Robots Exclusion Standard data for arachnid-manga.fandom.com
Resource Scan
Scan Details
Site Domain | arachnid-manga.fandom.com |
Base Domain | fandom.com |
Scan Status | Ok |
Last Scan | 2024-10-10T11:18:05+00:00 |
Next Scan | 2024-10-24T11:18:05+00:00 |
Last Scan
Scanned | 2024-10-10T11:18:05+00:00 |
URL | https://arachnid-manga.fandom.com/robots.txt |
Domain IPs | 199.232.208.194, 199.232.212.194 |
Response IP | 199.232.212.194 |
Found | Yes |
Hash | 90ee535620d57fe4fe1e8e00d021b4b810dff2bb525e69408e67fea909b00bf1 |
SimHash | 605c9ad04901 |
Groups
*
Rule | Path |
---|---|
Allow | /api.php? |
Allow | /api.php?action= |
Allow | /api.php?*&action= |
Allow | /wiki/Special%3ACreateNewWiki |
Allow | /wiki/Special%3AAllMaps |
Disallow | /wiki/Special%3A |
Disallow | /wiki/User_talk%3A |
Disallow | /wiki/Template%3A |
Disallow | /wiki/Template_talk%3A |
Disallow | /wiki/Help%3A |
Disallow | /wiki/User%3A |
Disallow | /wiki/UserProfile%3A |
Other Records
Field | Value |
---|---|
sitemap | https://arachnid-manga.fandom.com/sitemap-newsitemapxml-index.xml |
Warnings
- `noindex` is not a known field.