popbela.com
robots.txt

Robots Exclusion Standard data for popbela.com

Resource Scan

Scan Details

Site Domain popbela.com
Base Domain popbela.com
Scan Status Ok
Last Scan2024-09-17T06:43:08+00:00
Next Scan 2024-09-24T06:43:08+00:00

Last Scan

Scanned2024-09-17T06:43:08+00:00
URL https://popbela.com/robots.txt
Redirect https://www.popbela.com/robots.txt
Redirect Domain www.popbela.com
Redirect Base popbela.com
Domain IPs 13.33.30.104, 13.33.30.124, 13.33.30.33, 13.33.30.67
Redirect IPs 18.155.68.101, 18.155.68.13, 18.155.68.69, 18.155.68.84
Response IP 18.155.68.69
Found Yes
Hash 1be82df9d33480a8d0d4e8f1fd65d24859e9a84c28b957456fd6042cdc857a08
SimHash 80cd3d59c5f3

Groups

facebookexternalhit

Rule Path
Allow /content-images/post/*

googlebot

Rule Path
Disallow *?utm_source=

twitterbot

Rule Path
Allow *?utm_source=

*

Rule Path
Disallow /ajax/*
Disallow /preview/
Disallow /ajax-get-next-article/
Disallow /253109699/PopbelaMobile/
Disallow /author*
Disallow /search*
Disallow *?utm_source=*
Disallow *?fb_comment_id=*
Disallow *_next/image?*
Disallow /article-detail/*

alexabot

Rule Path
Disallow /*/amp/

Other Records

Field Value
sitemap https://www.popbela.com/sitemap.xml