Troubleshooting AWS Glue Connector for HubSpot Data Transfer

Select Language:

If you’re experiencing issues setting up HubSpot with AWS Glue, here are some straightforward steps to help you fix the problems.

First, let’s tackle the authorization and redirect URL error. This usually happens when the URL set up in your HubSpot app doesn’t match what AWS Glue expects during the OAuth process. When connecting HubSpot in AWS Glue, the OAuth flow uses the AUTHORIZATION_CODE grant type, which redirects you to HubSpot for login. You need to make sure that the redirect URL registered in your HubSpot connected app is exactly correct for your region. For example, if you’re working in the EU West Region (eu-west-2), your redirect URL should be:
https://eu-west-2.console.aws.amazon.com/gluestudio/oauth

If the error shows that AWS Glue is trying to use a different URL, like https://3rdp.oauth.console.api.aws, then the configuration needs to be checked. Make sure the app’s redirect URL is set to the correct regional URL and that you’ve properly selected the necessary scopes, particularly under CRM and Standard sections when creating your HubSpot developer app.

Next, consider the connection not found error. When it says that a connection with a specific name isn’t found, the problem is usually that the connection reference in your Glue job does not match an existing connection or the connection has been deleted. To fix this, verify that:

– The connection name in your Glue job matches exactly the name of the connection you created.
– The connection still exists in AWS Glue and hasn’t been removed.
– You’re including the connection as part of your network configuration in the Glue job.
– Your IAM role has the correct permissions to access the connection and read secrets from AWS Secrets Manager.

Additionally, ensure that you’ve stored your HubSpot app’s Consumer Secret in AWS Secrets Manager under the key USER_MANAGED_CLIENT_APPLICATION_CLIENT_SECRET. Your IAM role should have permissions to read this secret.

Following these steps should help you resolve the URL mismatch and connection issues quickly. If you need more details, AWS has detailed documentation on configuring HubSpot connections that can walk you through each step.