slurrp.com
robots.txt

Robots Exclusion Standard data for slurrp.com

Resource Scan

Scan Details

Site Domain slurrp.com
Base Domain slurrp.com
Scan Status Ok
Last Scan2024-05-13T02:35:03+00:00
Next Scan 2024-05-20T02:35:03+00:00

Last Scan

Scanned2024-05-13T02:35:03+00:00
URL https://slurrp.com/robots.txt
Redirect https://www.slurrp.com/robots.txt
Redirect Domain www.slurrp.com
Redirect Base slurrp.com
Domain IPs 125.56.219.42, 2600:1413:b000:1f::17d1:2e08, 2600:1413:b000:1f::17d1:2e1f, 96.17.72.81
Redirect IPs 18.155.68.13, 18.155.68.37, 18.155.68.70, 18.155.68.93, 2600:9000:23d2:2a00:16:76c0:8b00:93a1, 2600:9000:23d2:400:16:76c0:8b00:93a1, 2600:9000:23d2:4600:16:76c0:8b00:93a1, 2600:9000:23d2:5600:16:76c0:8b00:93a1, 2600:9000:23d2:7a00:16:76c0:8b00:93a1, 2600:9000:23d2:9200:16:76c0:8b00:93a1, 2600:9000:23d2:ae00:16:76c0:8b00:93a1, 2600:9000:23d2:b800:16:76c0:8b00:93a1
Response IP 18.155.68.93
Found Yes
Hash 3e37568ce15c63927d473fd389c557ceb382acb25061af89e26b7ba6983b639b
SimHash 5b12d7046631

Groups

*

Rule Path
Allow /
Disallow */community/post/*
Disallow /article_preview
Disallow *--*
Disallow *-$
Disallow *%3B*
Disallow *//*
Disallow /webview-article-details/
Disallow /?utm_source*
Disallow /discover/recipes?*
Disallow /discover/recipes-list?*
Disallow /*?utm*
Disallow /*%26utm*
Disallow /*web_only
Disallow */article/article/*
Disallow *1/$
Disallow *2/$
Disallow *3/$
Disallow *4/$
Disallow *5/$
Disallow *6/$
Disallow *7/$
Disallow *8/$
Disallow *9/$
Disallow *gl%3D*
Disallow *?page*
Disallow */users/*
Disallow */banner/*
Disallow *?iu=*
Disallow *?tags=*
Disallow */recipes/1*
Disallow */recipes/2*
Disallow */recipes/3*
Disallow */recipes/4*
Disallow */recipes/5*
Disallow */recipes/6*
Disallow */recipes/7*
Disallow */recipes/8*
Disallow */recipes/9*
Disallow *?type=BBB*
Disallow *search?type*
Disallow *articles%26page*
Disallow /web-stories/*article*
Disallow new_search?
Disallow *%3Ddiscover%26search%3D*
Disallow /slurrp360/*?type=recipes*
Disallow /slurrp360/*?type=videos*
Disallow /slurrp360/*?type=articles*
Disallow /slurrp360/*?type=photos*
Disallow *?articleType=Syndicated*

Other Records

Field Value
sitemap https://www.slurrp.com/sitemap.xml
sitemap https://www.slurrp.com/sitemap/recipe.xml
sitemap https://www.slurrp.com/sitemap/listicle.xml
sitemap https://www.slurrp.com/sitemap/article.xml