It might be straightforward to get started, but I’m pretty sure it’s not straightforward for Lambda to enable this. Also: RIP Cloud9.
“Getting started with remote debugging is straightforward.”
https://aws.amazon.com/blogs/aws/simplify-serverless-development-with-console-to-ide-and-remote-debugging-for-aws-lambda/