uniquesoftwaredev.com
robots.txt

Robots Exclusion Standard data for uniquesoftwaredev.com

Resource Scan

Scan Details

Site Domain uniquesoftwaredev.com
Base Domain uniquesoftwaredev.com
Scan Status Ok
Last Scan2025-10-16T19:18:50+00:00
Next Scan 2025-11-15T19:18:50+00:00

Last Scan

Scanned2025-10-16T19:18:50+00:00
URL https://uniquesoftwaredev.com/robots.txt
Domain IPs 54.158.102.197
Response IP 54.158.102.197
Found Yes
Hash e6b38f9011a71486768d80ddf8486dab50fb22a53e35e195297d05961697397e
SimHash 051dda4145f9

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

gptbot

Rule Path
Allow /

anthropic

Rule Path
Allow /

ccbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

yandexbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

gemini

Rule Path
Allow /

copilot

Rule Path
Allow /

microsoft-copilot

Rule Path
Allow /

google-extended

Product Comment
google-extended For Google AI Overview, SGE, Bard
Rule Path
Allow /

*

Rule Path
Allow /
Disallow /account/
Disallow /pay.facebook.com/
Disallow /?gazette-217710-JCZCyTbnk%2F
Disallow /?tQZk%2Fgazette565420%2F
Disallow /?gazette-1721850-FObKnNv%2F
Disallow /?creatureling-1730861-CnRtThu%2F
Disallow /?XbVATgZ%2F
Disallow /?creatureling-280566-cRuoBTzoL
Disallow /?Ahepatokla-1301253-RYqcOaFIu%2F
Disallow /?JCPb%2F
Disallow /?mtMUmO%2F
Disallow /?
Allow /

Other Records

Field Value
sitemap https://uniquesoftwaredev.com/sitemap_index.xml

Comments

  • Allow All Bots Full Access