Log In Sign Up

tawseel.com
robots.txt

Robots Exclusion Standard data for tawseel.com

Resource Scan

Scan Details

Site Domain tawseel.com
Base Domain tawseel.com
Scan Status Ok
Last Scan2024-10-25T01:22:43+00:00
Next Scan 2024-11-24T01:22:43+00:00

Last Scan

Scanned2024-10-25T01:22:43+00:00
URL https://tawseel.com/robots.txt
Redirect https://www.tawseel.com/content/tawseel/robots.txt
Redirect Domain www.tawseel.com
Redirect Base tawseel.com
Domain IPs 3.250.251.107
Redirect IPs 18.155.68.114, 18.155.68.127, 18.155.68.77, 18.155.68.81, 2600:9000:23d2:3e00:7:246c:3b40:93a1, 2600:9000:23d2:5600:7:246c:3b40:93a1, 2600:9000:23d2:6a00:7:246c:3b40:93a1, 2600:9000:23d2:6e00:7:246c:3b40:93a1, 2600:9000:23d2:8200:7:246c:3b40:93a1, 2600:9000:23d2:b000:7:246c:3b40:93a1, 2600:9000:23d2:ce00:7:246c:3b40:93a1, 2600:9000:23d2:d400:7:246c:3b40:93a1
Response IP 18.155.68.114
Found Yes
Hash 16940fce94c097f8bdd3faa84fc4a030597521a74816c93391488b7d3e6f6592
SimHash 2f157c86c553

Groups

googlebot*

Rule Path
Disallow /services/
Disallow /content/common/
Disallow /etc/
Disallow /bin/
Disallow /apps/

bingbot*

Rule Path
Disallow /services/
Disallow /content/common/
Disallow /etc/
Disallow /bin/
Disallow /apps/

slurp

Rule Path
Disallow /services/
Disallow /content/common/
Disallow /etc/
Disallow /bin/
Disallow /apps/

duckduckbot

Rule Path
Disallow /services/
Disallow /content/common/
Disallow /etc/
Disallow /bin/
Disallow /apps/

facebot

Rule Path
Disallow /services/
Disallow /content/common/
Disallow /etc/
Disallow /bin/
Disallow /apps/

ia_archiver

Rule Path
Disallow /services/
Disallow /content/common/
Disallow /etc/
Disallow /bin/
Disallow /apps/

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.tawseel.com/sitemap.xml
Back to top