forsalg.net
robots.txt
Robots Exclusion Standard data for forsalg.net
Resource Scan
Scan Details
Site Domain | forsalg.net |
Base Domain | forsalg.net |
Scan Status | Ok |
Last Scan | 2024-05-31T12:16:59+00:00 |
Next Scan | 2024-06-30T12:16:59+00:00 |
Last Scan
Scanned | 2024-05-31T12:16:59+00:00 |
URL | https://forsalg.net/robots.txt |
Domain IPs | 104.21.1.125, 172.67.152.62, 2606:4700:3035::ac43:983e, 2606:4700:3037::6815:17d |
Response IP | 172.67.152.62 |
Found | Yes |
Hash | 4edbbeacbe95bce99420ed43a6681f6d08c7286a792ccd00b96dc42879602a1a |
SimHash | 98441c56c193 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Allow | / |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /ajax/ |
Disallow | /assets/ |
Disallow | /css/ |
Disallow | /js/ |
Disallow | /vendor/ |
Disallow | /main.php |
Disallow | /mix-manifest.json |
Other Records
Field | Value |
---|---|
sitemap | https://forsalg.net/no/sitemaps.xml |