Log In Sign Up

cleanipedia.com
robots.txt

Robots Exclusion Standard data for cleanipedia.com

Resource Scan

Scan Details

Site Domain cleanipedia.com
Base Domain cleanipedia.com
Scan Status Ok
Last Scan2024-06-28T19:34:53+00:00
Next Scan 2024-07-05T19:34:53+00:00

Last Scan

Scanned2024-06-28T19:34:53+00:00
URL https://cleanipedia.com/robots.txt
Redirect https://www.cleanipedia.com/robots.txt
Redirect Domain www.cleanipedia.com
Redirect Base cleanipedia.com
Domain IPs 54.208.45.22
Redirect IPs 18.155.68.103, 18.155.68.27, 18.155.68.59, 18.155.68.94
Response IP 18.155.68.103
Found Yes
Hash 26ccc106e4d0dd860d16b1f54caa94463d8dd7ae1db3dea9344efa8ba58cc70e
SimHash fc852265e3f4

Groups

*

Rule Path
Disallow /bin/
Disallow /etc/tags/
Disallow *?_escaped_fragment_=*
Disallow /analytics-iframe/
Disallow /?
Disallow *utm_%3D

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.cleanipedia.com/ar/sitemap.xml
sitemap https://www.cleanipedia.com/ar/images.sitemap.xml
sitemap https://www.cleanipedia.com/ar/videos.sitemap.xml
sitemap https://www.cleanipedia.com/bd/sitemap.xml
sitemap https://www.cleanipedia.com/bd/images.sitemap.xml
sitemap https://www.cleanipedia.com/bd/videos.sitemap.xml
sitemap https://www.cleanipedia.com/br/sitemap.xml
sitemap https://www.cleanipedia.com/br/images.sitemap.xml
sitemap https://www.cleanipedia.com/br/videos.sitemap.xml
sitemap https://www.cleanipedia.com/za/sitemap.xml
sitemap https://www.cleanipedia.com/za/images.sitemap.xml
sitemap https://www.cleanipedia.com/za/videos.sitemap.xml
sitemap https://www.cleanipedia.com/ph/sitemap.xml
sitemap https://www.cleanipedia.com/ph/images.sitemap.xml
sitemap https://www.cleanipedia.com/ph/videos.sitemap.xml
sitemap https://www.cleanipedia.com/vn/sitemap.xml
sitemap https://www.cleanipedia.com/vn/images.sitemap.xml
sitemap https://www.cleanipedia.com/vn/videos.sitemap.xml
sitemap https://www.cleanipedia.com/de/sitemap.xml
sitemap https://www.cleanipedia.com/de/images.sitemap.xml
sitemap https://www.cleanipedia.com/de/videos.sitemap.xml
sitemap https://www.cleanipedia.com/gb/sitemap.xml
sitemap https://www.cleanipedia.com/gb/images.sitemap.xml
sitemap https://www.cleanipedia.com/gb/videos.sitemap.xml
sitemap https://www.cleanipedia.com/pl/sitemap.xml
sitemap https://www.cleanipedia.com/pl/images.sitemap.xml
sitemap https://www.cleanipedia.com/pl/videos.sitemap.xml
sitemap https://www.cleanipedia.com/th/sitemap.xml
sitemap https://www.cleanipedia.com/th/images.sitemap.xml
sitemap https://www.cleanipedia.com/th/videos.sitemap.xml
sitemap https://www.cleanipedia.com/ae/ar/sitemap.xml
sitemap https://www.cleanipedia.com/ae/ar/images.sitemap.xml
sitemap https://www.cleanipedia.com/ae/ar/videos.sitemap.xml
sitemap https://www.cleanipedia.com/nl/sitemap.xml
sitemap https://www.cleanipedia.com/nl/images.sitemap.xml
sitemap https://www.cleanipedia.com/nl/videos.sitemap.xml
sitemap https://www.cleanipedia.com/dk/sitemap.xml
sitemap https://www.cleanipedia.com/dk/images.sitemap.xml
sitemap https://www.cleanipedia.com/dk/videos.sitemap.xml
sitemap https://www.cleanipedia.com/id/sitemap.xml
sitemap https://www.cleanipedia.com/id/images.sitemap.xml
sitemap https://www.cleanipedia.com/id/videos.sitemap.xml
sitemap https://www.cleanipedia.com/fi/sitemap.xml
sitemap https://www.cleanipedia.com/fi/images.sitemap.xml
sitemap https://www.cleanipedia.com/fi/videos.sitemap.xml
sitemap https://www.cleanipedia.com/se/sitemap.xml
sitemap https://www.cleanipedia.com/se/images.sitemap.xml
sitemap https://www.cleanipedia.com/se/videos.sitemap.xml
Back to top