siupress.com
robots.txt

Robots Exclusion Standard data for siupress.com

Resource Scan

Scan Details

Site Domain siupress.com
Base Domain siupress.com
Scan Status Ok
Last Scan5/6/2025, 9:59:06 PM
Next Scan 6/5/2025, 9:59:06 PM

Last Scan

Scanned5/6/2025, 9:59:06 PM
URL https://siupress.com/robots.txt
Domain IPs 104.21.33.88, 172.67.160.182, 2606:4700:3033::ac43:a0b6, 2606:4700:3036::6815:2158
Response IP 104.21.33.88
Found Yes
Hash abc5c3e39ce33e4f6a7df1b491ebdfee577f7e9f374240db9f05dd5bf8f53f9f
SimHash 6804d000c1a7

Groups

*

Rule Path
Disallow /

applebot

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

bingbot

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

discordbot

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

duckduckbot

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

facebookexternalhit

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

googlebot-image

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

ia_archiver

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

linkedinbot

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

msnbot

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

pinterestbot

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

slurp

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

teoma

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

twitterbot

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

yandex

Rule Path
Disallow /wp-admin/
Disallow /search*
Allow /
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.siupress.com/sitemap_index.xml