Upscaling or creating new EC2 engines fail with below limit error:
ERROR - User_Group3_Engine engine creation: Failed. {"errorMessage":"Failure while attempting to run instances. There are not enough free addresses in subnet 'subnet-000245' to satisfy the requested number of instances. (Service: Ec2, Status Code: 400, Request ID: 4285-3fd6-4e05-8dd9-484444, Extended Request ID: null)","context":[],"moreInfo":""}ERROR - User_Group3_Engine engine creation: Failed. {"errorMessage":"Failure while attempting to run instances. There are not enough free addresses in subnet 'subnet-00405f36c81d62ee4' to satisfy the requested number of instances. (Service: Ec2, Status Code: 400, Request ID: 965e4285-3fd6-4e05-8dd9-484448728b84, Extended Request ID: null)","context":[],"moreInfo":""}
Applicable for: AWS AWS Deployment : Dremio AWSE or Dremio Cloud Edition
CAUSE:
- This is an AWS specific Limit issue and related to the VPC Subnet CIDR Range (and the available AWS IP Addresses for that Dremio subnet)
- This error generally indicates the specified subnet for Dremio does not have any free private IP addresses. From the above error in our example it's 'subnet-000245' (Please verify)
SUGGESTIONS:
A) Kindly review from your AWS VPC side for the available IP Addresses in this Subnet (specified for Dremio) :
Check how many IP addresses are available in your subnet by going to the Subnets page in the Amazon VPC console. You can view the Available IPs in the details pane for your subnet. To create free IP addresses in your subnet, you can delete unused network interfaces, or terminate instances that you do not require.
B) and check the CIDR block range specified for the Dremio Subnet.
Also please ensure this VPC subnet is used specifically for your Dremio Deployment for dedicated resources.
> If needed, you might need to add additional CIDR Blocks to your VPC subnet: Please refer below AWSE doc for further details:
Reference[2]: https://docs.aws.amazon.com/vpc/latest/userguide/vpc-cidr-blocks.html
Reference[3]: https://docs.aws.amazon.com/vpc/latest/userguide/modify-vpcs.html#add-ipv4-cidr
- When you create a VPC, you must specify an IPv4 CIDR block for the VPC. The allowed block size is between a
/16
netmask (65,536 IP addresses) and/28
netmask (16 IP addresses). After you've created your VPC, you can associate additional IPv4 CIDR blocks with the VPC. For more information, see Add an IPv4 CIDR block to your VPC.