clevertize.com
robots.txt

Robots Exclusion Standard data for clevertize.com

Resource Scan

Scan Details

Site Domain clevertize.com
Base Domain clevertize.com
Scan Status Ok
Last Scan2025-10-19T09:49:17+00:00
Next Scan 2025-11-18T09:49:17+00:00

Last Scan

Scanned2025-10-19T09:49:17+00:00
URL https://clevertize.com/robots.txt
Domain IPs 162.0.215.153
Response IP 162.0.215.153
Found Yes
Hash 50847b673d7c52a8f2189f9c46dc27eeb2cdb6c5817a1c727014e5938f63ab9f
SimHash ea25ace0a980

Groups

*

Rule Path
Disallow /demosites
Disallow /hrms
Disallow /resume
Disallow /oldsite
Disallow /Bots
Disallow /crm
Disallow /email
Disallow /emailers
Disallow /fbpost
Disallow /testing
Disallow /career-demo.php
Disallow /career-demo1.php
Disallow /demoSubmit.php
Disallow /demofile
Disallow /work/campaign/demoCampaign.php

Other Records

Field Value
sitemap https://www.clevertize.com/sitemap.xml
sitemap https://www.clevertize.com/news-sitemap.xml