androidworld.be
robots.txt
Robots Exclusion Standard data for androidworld.be
Resource Scan
Scan Details
Site Domain | androidworld.be |
Base Domain | androidworld.be |
Scan Status | Ok |
Last Scan | 2024-09-21T02:39:15+00:00 |
Next Scan | 2024-09-28T02:39:15+00:00 |
Last Scan
Scanned | 2024-09-21T02:39:15+00:00 |
URL | https://androidworld.be/robots.txt |
Domain IPs | 178.128.143.203 |
Response IP | 178.128.143.203 |
Found | Yes |
Hash | eec286353f0c4af02f85dc9895b9238d3077bc737f4cb4fbc9838cdc230208ef |
SimHash | 501cd975e413 |
Groups
*
Rule | Path |
---|---|
Disallow | /user/ |
Disallow | /aw-affiliate |
Disallow | /out/ |
Disallow | /search?q= |
Disallow | /*?comment= |
Disallow | /*?action= |
Other Records
Field | Value |
---|---|
sitemap | https://androidworld.be/sitemap/news.xml |
sitemap | https://androidworld.be/sitemap/pages.xml |
Comments