sosidee.com
robots.txt

Robots Exclusion Standard data for sosidee.com

Resource Scan

Scan Details

Site Domain sosidee.com
Base Domain sosidee.com
Scan Status Ok
Last Scan2025-05-14T08:12:33+00:00
Next Scan 2025-06-13T08:12:33+00:00

Last Scan

Scanned2025-05-14T08:12:33+00:00
URL https://sosidee.com/robots.txt
Domain IPs 46.254.36.239
Response IP 46.254.36.239
Found Yes
Hash 6363ef19e63ca37052383d96e015dcbb0e4bac552a7b9dd46d7a61cbc18589b2
SimHash a8000b025370

Groups

*

Rule Path
Disallow /trackback/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /xmlrpc.php
Disallow /wp-
Disallow /cgi-bin
Disallow /readme.html
Disallow /license.txt
Disallow /*?*
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*/wp-*
Disallow /*/feed/*
Disallow /*/*?s=*
Disallow /*/*.js$
Disallow /*/*.inc$
Allow /wp-content/uploads/

ia_archiver*

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

bidswitchbot/1.0

Rule Path
Disallow /

semalt

Rule Path
Disallow /

oai-searchbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

Comments

  • Disallow these directories, url types & file-types