Log In Sign Up

ukesong.com
robots.txt

Robots Exclusion Standard data for ukesong.com

Resource Scan

Scan Details

Site Domain ukesong.com
Base Domain ukesong.com
Scan Status Ok
Last Scan2026-03-23T06:54:31+00:00
Next Scan 2026-03-30T06:54:31+00:00

Last Scan

Scanned2026-03-23T06:54:31+00:00
URL https://ukesong.com/robots.txt
Domain IPs 104.21.93.208, 172.67.214.120, 2606:4700:3034::6815:5dd0, 2606:4700:3037::ac43:d678
Response IP 172.67.214.120
Found Yes
Hash 4c65da7d51de292887bb7f4c6abfd9626662fb5a15bd1237c63f26843eb022ba
SimHash 601ddb536283

Groups

scrapy

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /contact/
Allow /search/

ahrefssiteaudit

Rule Path
Allow /

googlebot

Rule Path
Disallow /*.pdf$
Disallow /*.swf$

googlebot-image
ahrefsbot-image

Rule Path
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*
Back to top

Other Records

Field Value
sitemap https://ukesong.com/sitemap_index.xml
Back to top

Comments

  • disallow all files in these directories
  • disallow all files ending with these extensions
  • allow google image bot to search all images
  • allow adsense bot on entire site
Back to top