slurrp.com
robots.txt
Robots Exclusion Standard data for slurrp.com
Resource Scan
Scan Details
Site Domain | slurrp.com |
Base Domain | slurrp.com |
Scan Status | Ok |
Last Scan | 2024-05-13T02:35:03+00:00 |
Next Scan | 2024-05-20T02:35:03+00:00 |
Last Scan
Scanned | 2024-05-13T02:35:03+00:00 |
URL | https://slurrp.com/robots.txt |
Redirect | https://www.slurrp.com/robots.txt |
Redirect Domain | www.slurrp.com |
Redirect Base | slurrp.com |
Domain IPs | 125.56.219.42, 2600:1413:b000:1f::17d1:2e08, 2600:1413:b000:1f::17d1:2e1f, 96.17.72.81 |
Redirect IPs | 18.155.68.13, 18.155.68.37, 18.155.68.70, 18.155.68.93, 2600:9000:23d2:2a00:16:76c0:8b00:93a1, 2600:9000:23d2:400:16:76c0:8b00:93a1, 2600:9000:23d2:4600:16:76c0:8b00:93a1, 2600:9000:23d2:5600:16:76c0:8b00:93a1, 2600:9000:23d2:7a00:16:76c0:8b00:93a1, 2600:9000:23d2:9200:16:76c0:8b00:93a1, 2600:9000:23d2:ae00:16:76c0:8b00:93a1, 2600:9000:23d2:b800:16:76c0:8b00:93a1 |
Response IP | 18.155.68.93 |
Found | Yes |
Hash | 3e37568ce15c63927d473fd389c557ceb382acb25061af89e26b7ba6983b639b |
SimHash | 5b12d7046631 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | */community/post/* |
Disallow | /article_preview |
Disallow | *--* |
Disallow | *-$ |
Disallow | *%3B* |
Disallow | *//* |
Disallow | /webview-article-details/ |
Disallow | /?utm_source* |
Disallow | /discover/recipes?* |
Disallow | /discover/recipes-list?* |
Disallow | /*?utm* |
Disallow | /*%26utm* |
Disallow | /*web_only |
Disallow | */article/article/* |
Disallow | *1/$ |
Disallow | *2/$ |
Disallow | *3/$ |
Disallow | *4/$ |
Disallow | *5/$ |
Disallow | *6/$ |
Disallow | *7/$ |
Disallow | *8/$ |
Disallow | *9/$ |
Disallow | *gl%3D* |
Disallow | *?page* |
Disallow | */users/* |
Disallow | */banner/* |
Disallow | *?iu=* |
Disallow | *?tags=* |
Disallow | */recipes/1* |
Disallow | */recipes/2* |
Disallow | */recipes/3* |
Disallow | */recipes/4* |
Disallow | */recipes/5* |
Disallow | */recipes/6* |
Disallow | */recipes/7* |
Disallow | */recipes/8* |
Disallow | */recipes/9* |
Disallow | *?type=BBB* |
Disallow | *search?type* |
Disallow | *articles%26page* |
Disallow | /web-stories/*article* |
Disallow | new_search? |
Disallow | *%3Ddiscover%26search%3D* |
Disallow | /slurrp360/*?type=recipes* |
Disallow | /slurrp360/*?type=videos* |
Disallow | /slurrp360/*?type=articles* |
Disallow | /slurrp360/*?type=photos* |
Disallow | *?articleType=Syndicated* |
Other Records
Field | Value |
---|---|
sitemap | https://www.slurrp.com/sitemap.xml |
sitemap | https://www.slurrp.com/sitemap/recipe.xml |
sitemap | https://www.slurrp.com/sitemap/listicle.xml |
sitemap | https://www.slurrp.com/sitemap/article.xml |