❓ Question: How to Properly Pass crawler_params in n8n Node
#958
Unanswered
Mirindi
asked this question in
Forums - Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi team! I'm trying to use Crawl4AI in an n8n workflow and struggling to pass the
crawler_paramsobject inside the request body.Here's an example of what I'm trying to send:
{ "request": { "urls": "{{ $('Loop Over Items').item.json['sitemapindex.sitemap'].loc }}", "crawler_params": { "headless": true, "browser_type": "chromium", "user_agent": "Mozilla/5.0 ...", "page_timeout": 30000, "verbose": true, "semaphore_count": 5, "simulate_user": true, "magic": true, "override_navigator": true, "user_data_dir": "./browser-data", "use_managed_browser": true, "headers": { "Accept-Language": "en-US,en;q=0.9" } } } }But n8n always throws a Failed on navigating ACS-GOTO :\nPage.goto: net::ERR_HTTP2_PROTOCOL_ERROR at https://www.carrefour.ke/sitemaps/clp_en.xml\nCall log:\nnavigating to "https://www.carrefour.ke/sitemaps/clp_en.xml", waiting until "domcontentloaded"\n error.
I’ve tried escaping the mustache template, building it in code, using a Function node, etc.—no luck. What is the correct way to dynamically pass
crawler_paramsandurlsinto a Crawl4AI request from an n8n node?Any guidance or examples would be super appreciated!
Thanks 🙏
Beta Was this translation helpful? Give feedback.
All reactions