dailymem.pl
robots.txt
Robots Exclusion Standard data for dailymem.pl
Resource Scan
Scan Details
Site Domain | dailymem.pl |
Base Domain | dailymem.pl |
Scan Status | Ok |
Last Scan | 2024-09-26T18:40:56+00:00 |
Next Scan | 2024-10-03T18:40:56+00:00 |
Last Scan
Scanned | 2024-09-26T18:40:56+00:00 |
URL | https://dailymem.pl/robots.txt |
Domain IPs | 195.78.67.34 |
Response IP | 195.78.67.34 |
Found | Yes |
Hash | 29525d9c2fea71a677aeba41f159185cf4370abb243441b097b6dec3f4c7d3f2 |
SimHash | d8795448a393 |
Groups
*
Rule | Path |
---|---|
Disallow | /assets/ |
Disallow | /test/ |
Disallow | /vendor/ |
Disallow | /site/user |
Disallow | /my-posts |
Disallow | /site/generate-sitemaps |
Disallow | /contest/rules |
Disallow | /site/rules |
Disallow | /site/privacy-policy |
Other Records
Field | Value |
---|---|
sitemap | https://dailymem.pl/sitemap.xml |