gagadget.com
robots.txt
Robots Exclusion Standard data for gagadget.com
Resource Scan
Scan Details
Site Domain | gagadget.com |
Base Domain | gagadget.com |
Scan Status | Ok |
Last Scan | 2024-11-01T23:29:45+00:00 |
Next Scan | 2024-11-08T23:29:45+00:00 |
Last Scan
Scanned | 2024-11-01T23:29:45+00:00 |
URL | https://gagadget.com/robots.txt |
Domain IPs | 195.201.8.180 |
Response IP | 195.201.8.180 |
Found | Yes |
Hash | 5b100d11caa3700d2957ca495b23c36e45cf828da011d8cfe24d268b8be4e80b |
SimHash | aa9cce35e612 |
Groups
*
Rule | Path |
---|---|
Disallow | *page%3D1$ |
Disallow | *show_all%3D1 |
Disallow | *type%3Dany |
Disallow | *order_by |
Disallow | /registration/ |
Disallow | /forum/ |
Disallow | /forum/*p%3D |
Disallow | /forum/*daysprune |
Disallow | /forum/*langid |
Disallow | /today/ |
Disallow | /sale/*order |
Disallow | *?o=w |
Disallow | *?o=n |
Disallow | *?o=r |
Disallow | *?o=o |
Disallow | /node/ |
Disallow | /sale/send-message/ |
Disallow | /messages/ |
Disallow | /sellers/ |
Disallow | /search/ |
Disallow | /discussions/add-theme-discussion/ |
Disallow | /sale/*price_from |
Disallow | /sale/*has_delivery |
Disallow | /sale/*has_photo |
Disallow | /sale/send-message |
Disallow | /sale/*seller_id |
Disallow | /commentators/ |
Disallow | /experts/ |
Disallow | *?q= |
Disallow | *?destination= |
Disallow | *?*branding= |
Other Records
Field | Value |
---|---|
sitemap | https://gagadget.com/sitemap.xml |