How to Enhance Content Quality at Scale with AI

To find intent gaps in content using AI, follow these steps:

1. Crawl your content URLs: Use a tool like Screaming Frog SEO spider to crawl your website.
2. Analyze the text content: Utilize ChatGPT via the OpenAI API to analyze the text content on each page.
3. Compare with intent map: Compare the analyzed content to an intent map derived from Google's People Also Ask (PAA) data to identify gaps.
4. Generate a spreadsheet: The result will be a spreadsheet listing questions that your content does not answer but are related to the page’s intent according to Google.

This process can save hundreds of hours by automating the identification of content gaps.

To find intent gaps in content, you will need the following tools:

1. Screaming Frog SEO spider: A web crawler that can execute custom JavaScript while crawling.
2. OpenAI API: To interact programmatically with ChatGPT for content analysis.
3. AlsoAsked API: To query and access People Also Asked data programmatically in any language/region supported by Google.

These tools work together to crawl your content, analyze it, and compare it to PAA data to identify gaps.

People Also Ask (PAA) data is powerful for SEO for several reasons:

• Intent Clustering by Google: PAA boxes help users refine queries and provide Google with interaction data to understand user intent.
• Time To Result (TTR): Google measures how quickly a user completes their mission, and including searches in close 'intent proximity' to your topic can reduce TTR.
• Zero Volume Keywords: PAA data can reveal queries that traditional keyword tools might miss, providing detailed insights into user intent.
• Recency: PAA data updates quickly, allowing you to see if your content needs updating to align with current search intent.

These advantages make PAA data an invaluable resource for improving content relevance and ranking.

To configure Screaming Frog for finding unanswered questions using ChatGPT and AlsoAsked, follow these steps:

1. Update Screaming Frog: Ensure you have the latest version (v20.1 or higher).
2. Crawl site URLs: Start a standard crawl of your website and filter to view content URLs.
3. Import CustomJS: Go to Configuration > Custom > Custom JavaScript, and add the (AlsoAsked+ChatGPT) Find unanswered questions script from the library.
4. Configure API keys: Edit the imported JavaScript with your OpenAI and AlsoAsked API keys.
5. Review settings: Configure PAA language and region, and customize the ChatGPT prompt if needed.
6. Run List crawl for selected URLs: Ensure rendering mode is set to JavaScript and import your list of URLs.
7. View results: Check the Custom JavaScript tab for unanswered questions and export the results for review.

This setup allows you to automate the identification of content gaps using AI and PAA data.

The new Custom JavaScript feature in Screaming Frog offers several benefits:

• Data Extraction: Allows you to execute custom JavaScript while crawling, enabling data extraction on-the-go.
• Integration with APIs: Facilitates integration with APIs like OpenAI and AlsoAsked to perform advanced content analysis.
• Automation: Automates the process of identifying unanswered questions in your content, saving significant manual effort.
• Flexibility: Customizable prompts and settings to tailor the analysis to your specific needs.

These benefits make the Custom JavaScript feature a powerful tool for enhancing SEO workflows and improving content quality.