WPIntell

Source evidence

Caching?

Better Robots.txt – AI-Ready Crawl Control & Bot Governance · support · 2020-06-23T18:05:00+00:00

mixedsentiment
mediumseverity
0.67relevance
1replies
Evidence linked to opportunitycommercial context

Proof Health

Open evidence

Commercial opportunities need traceable source links before they are treated as build-worthy.

5 / 34 rows with source links

14.7% of this page's analysis has direct source links.

0 build-decision rows missing links

0 rows here require auditable proof before promotion.

29 rows with no attached evidence

0 rows have source counts but still need direct links.

Conversation

support
eclev91 resolved
Don’t know how often bots are reading robots.txt, but a virtual robots.txt has to be generated by WP each time it’s hit. Does the virtual generation play nice with any existing caching plugins so that it can be served statically unless flushed, preventing WP from having to load every time this endpoint gets hit? Hi, Thank you for contacting our support. About your question, we have never had any issue with Better Robots.txt and Cache plugins … Is it your case ? Let us know Regards

Comments

1 shown
Pagup 2020-06-26T04:49:00+00:00

Hi, Thank you for contacting our support. About your question, we have never had any issue with Better Robots.txt and Cache plugins … Is it your case ? Let us know Regards