๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
  • ๐Ÿ‘ฉ๐Ÿปโ€๐Ÿ’ป ๐ŸŒฎ ๐Ÿ’ฌ

๐Ÿ‘ฉ๐Ÿป‍๐Ÿ’ป/aws3

[AWS] lambda function ์œผ๋กœ ec2 instance rebootํ•˜๊ธฐ airflow์„ ์šด์˜ํ•˜๋Š” ec2 instance๊ฐ€ ์•„์ฃผ ๋ฌด๊ฒ๊ฒŒ ๋Œ์•„๊ฐ€๊ณ  ์žˆ๋Š” ์ƒํ™ฉ์ด๋‹ค..๊ทธ๋ž˜์„œ ๊ทธ๋Ÿฐ์ง€ ์ผ์ฃผ์ผ์— ํ•œ๋ฒˆ์”ฉ airflow๊ฐ€ ์‹คํ–‰๋˜๊ณ  ์žˆ์ง€ ์•Š๋Š” ๊ฒฝ์šฐ๋“ค์ด ์žˆ๋‹ค. ์›์ธ ํŒŒ์•…์„ ์ œ๋Œ€๋กœ ํ•˜๊ณ  ๊ฐœ์„ฑํ•ด์•ผํ•˜์ง€๋งŒ ์šฐ์„  ์ง€๊ธˆ ๋‹น์žฅ ๋‚˜์˜จ ์กฐ์น˜๋กœ๋Š” ์ฃผ๊ธฐ์ ์œผ๋กœ ec2 instance๋ฅผ reboot ํ•˜์ž๋Š” ์˜๊ฒฌ! ๊ฐ€์žฅ ๊ฐ„๋‹จํ•œ ๋ฐฉ๋ฒ•์œผ๋กœ๋Š” rebootํ•˜๋Š” lambda function์„ ์ƒ์„ฑํ•œ ํ›„CloudWatch Events (EventBridge) ๋กœ ๊ทœ์น™์„ ์ƒ์„ฑํ•ด์„œ, ๊ณ ์ • ๊ฐ„๊ฒฉ์œผ๋กœ ํŠธ๋ฆฌ๊ฑฐ ์‹คํ–‰ํ•˜๋Š” ๋ฐฉ๋ฒ•! ๊ทผ๋ฐ CloudWatch Events (EventBridge) ์‚ฌ์šฉํ•˜๋ฉด ์ถ”๊ฐ€ ์š”๊ธˆ ๋ฐœ์ƒํ•˜๊ธฐ์— .. crontab ์œผ๋กœ ๊ด€๋ฆฌํ•˜๋Š” ๊ฑธ๋กœ ๊ฒฐ์ •ํ–ˆ๋‹ค. โœ… ์ง„ํ–‰1. AWS lambda function ์ƒ์„ฑ2. ์ƒ์„ฑํ•œ lamb.. 2024. 10. 29.
[AWS] SNS Topics์— ๋“ฑ๋กํ•œ Pending confirmation ์ƒํƒœ์˜ Subscription ์‚ญ์ œ ๊ฐœ์š”Amazon SNS์—์„œ Topic์„ ์ƒ์„ฑํ•˜๊ณ  Subscriptions์— email์„ createํ•˜๋Š” ๊ณผ์ •์—์„œ ์˜คํƒ€๊ฐ€ ๋ฐœ์ƒํ•˜์—ฌ ์ž˜๋ชป๋œ email์„ ๋“ฑ๋กํ•ด๋ฒ„๋ ธ๋‹ค.์ด๋ฏธ Request confirmation์ด ๋œ ์ƒํƒœ์ธ๋ฐ, ์ž˜๋ชป๋œ email์ด๋‹ˆ ์ธ์ฆ์ด ์ง„ํ–‰๋˜์ง€ ์•Š์•„์„œ Pending confirmation ๋ผ๋Š” status ๋กœ ์ž”๋ฅ˜ํ•˜๊ณ  ์žˆ๋‹ค. Pending confirmation ์ธ ์ƒํƒœ๊ฐ€ ์žˆ์œผ๋‹ˆ๊นŒ ํ•ด๋‹น Topic์„ ์‚ฌ์šฉํ•˜๋Š” Alarm์—๋„ warning ์ด ํ‘œ์‹œ๋œ๋‹ค. ์ง„ํ–‰1. AWS์—์„œ ๋ฐ”๋กœ ์‚ญ์ œ ์‹œ๋„ ์‚ญ์ œํ•˜๊ณ  ์‹ถ์€ email์„ ์„ ํƒํ•ด๋„ Edit, Delete ๋ฒ„ํŠผ์ด ๋น„ํ™œ์„ฑํ™”๋˜์–ด์„œ ์‚ญ์ œ๋ฅผ ์ง„ํ–‰ํ•  ์ˆ˜ ์—†๋‹ค.  2. python ์Šคํฌ๋ฆฝํŠธ๋กœ ์ ‘๊ทผํ•˜์—ฌ ์‚ญ์ œ ์‹œ๋„ ์ง์ ‘ ์ ‘๊ทผ์„ ์‹œ๋„ํ•ด์„œ ์‚ญ์ œ ์‹œ๋„import boto3#.. 2024. 8. 7.
[AWS] EC2 Instance์— Alarms ์ถ”๊ฐ€ํ•˜๊ธฐ [EC2 Instance] file descriptor leak issue๊ฐœ์š”Docker๋กœ Airflow๋ฅผ ๋„์šด ec2 instance๊ฐ€ ํ•œ,๋‘๋‹ฌ์— ํ•œ๋ฒˆ์”ฉ ssh ์ ‘๊ทผ์ด ๋ถˆ๊ฐ€๋Šฅํ•œ ์ƒํƒœ๊ฐ€ ๋ฐ˜๋ณต๋˜์—ˆ๋‹ค.AWS ec2 instance ์ƒํƒœ๋Š” running ์ƒํƒœ์ธ๋ฐ airflow๊ฐ€ ๋‚ด๋ ค๊ฐ€์žˆ๊ณ  ssh ์ ‘๊ทผ์ด ์•ˆ๋˜๋Š” ๊ฒƒ์ด ์„œ๋ฒ„๊ฐ€ ๋ฌด๊ฒ๊ฒŒ ๋Œbonory.tistory.com ์ด๋Ÿฐ ์ผ์ด ์žˆ์—ˆ๋‹ค๊ฐ‘์ž๊ธฐ cpu๊ฐ€ ์ฃฝ์–ด๋ฒ„๋ฆฌ๋Š” ์ผ !!! ๊ทธ๋ž˜์„œ cpu ๊ฐ€ ๋˜ ๊ฐ‘์ž๊ธฐ ์ฃฝ์–ด๋ฒ„๋ฆฌ๋ฉด Alarm ๋ฐ›์œผ๋ ค๊ณ  ํ•œ๋‹ค. CloudWatch ์—์„œ Alarms ์— ์ ‘๊ทผํ•œ๋‹ค. ๊ฑฐ๊ธฐ์„œ ์ด์ œ Create alarm๋ฅผ ํด๋ฆญํ•˜๊ณ  ์–ด๋–ค ec2 instance๋ฅผ, ์–ด๋– ํ•œ ๊ธฐ์ค€์œผ๋กœ alarm์„ ๋ฐ›์„ ๊ฒƒ์ธ์ง€ ์„ค์ •ํ•˜๋ฉด ๋œ๋‹ค.๋‚˜๋Š” ์ด๋ ‡๊ฒŒ ๋˜๋Š” ๊ฒฝ์šฐ๋ฅผ ์„ค์ •ํ•ด์ค„ ๊ฒƒ ์ธ๋ฐ ... 2024. 8. 6.