Shout out to me for not Tweeting that.
RT @taraw: More books for folks that love to #Golang /* Yes it’s corny but it’s late ABC’s that’s the best I got */ https://twitter.com/ProgrammerBooks/status/1169098978291593216
“Not actively maintained” 😢
https://github.com/Netflix/vizceral
“But how do we validate data fed into the pipelines to make sure tainted data does not accidentally sneak into the production system?” (via @Pocket) https://blog.fastforwardlabs.com/2019/08/28/two-approaches-for-data-validation-in-ml-production.html
“It looks like avoiding lock-in isn’t quite so easy and might even get you locked up into trying to escape from it.” (via @Pocket) #longreads https://martinfowler.com/articles/oss-lockin.html
“Now, the new paper reports that few real-world networks show convincing evidence of scale-freeness.” (via @Pocket) #longreads https://www.quantamagazine.org/scant-evidence-of-power-laws-found-in-real-world-networks-20180215/
Lock-in-A-Mole
Replying to @calehoopes
Yes.
This is fine.
“The first challenge is the organizational structure: different teams might own different parts of the process, and there is a hand over”
Continuous Delivery for Machine Learning https://martinfowler.com/articles/cd4ml.html
“Hearst plans to move more and more to serverless architectures and platform as a service.”
Hearst’s Multi-Cloud Strategy Taps AWS, Microsoft Azure, Google Cloud https://www.crn.com/news/cloud/hearst-s-multi-cloud-strategy-taps-aws-microsoft-azure-google-cloud
Empathy & Emotion FTW.
In service of the narrative https://lorinhochstein.wordpress.com/2019/08/24/in-service-of-the-narrative/
PaaS: Puppies as a Solution
Replying to @PreetamJinka
Too soon
Replying to @Millanisms
Replying to @monkchips
WetWork IPO imminent
Replying to @chrismunns, @txase, @gojkoadzic, @ranrib and @prashanth
Congratulations new heroes!
“Slack sells subscriptions to companies whose workers use its software to message one another and work together.” 🤔
https://www.nytimes.com/2019/09/04/technology/slack-earnings.html
Replying to @perrito666
Related: “Stewart Butterfield, Slack’s chief executive, said in an interview that it would take time for the market to understand his company since it had created a new category of software, unlike soda or cars.”
Replying to @perrito666
True
Replying to @_abhayshah
That seems reasonable. You can squeeze the balloon, but the volume remains.
Replying to @skpodila, @tmclaughbos and @sogrady
Fog makes the lasers really pop - just sayin.
“Version control machine learning models, data sets and intermediate files. DVC connects them with code and uses S3, Azure, GCP, SSH, Aliyun OSS or to store file contents.”
https://dvc.org/#
RT @ashleymcnamara: Tell me about a time when you experienced burnout and how you recognize / manage it today.
Please and Thank You ☺️
Replying to @ashleymcnamara
Took me too long to realize I was burnt out.
Time: indeterminate Symptoms: lack of interest/commitment, irritability, learned helplessness, cynicism. Partial Remedy: privileged to take sabbatical, connect with people (old and new), work on tangible things in world, hike 🗻s.
“With today’s launch, you will see dramatic improvements to function startup performance and more efficient usage of elastic network interfaces.”
https://aws.amazon.com/blogs/compute/announcing-improved-vpc-networking-for-aws-lambda-functions/
“So the process of building aligned and autonomous teams is the ongoing process, and the goal is fewer mistakes (at various levels) during software development and a greater throughput. "
Alignment and Autonomy and Quorums https://paulhammant.com/2017/07/09/alignment-and-autonomy-and-quorums/
“This misses a point of using a cloud, being not so much to save money, but to obtain lift by not having to build as well as better meeting the underlying demand for compute and data services, resulting in something akin to a Jevons’ effect.”
https://dehora.net/journal/leverage-in-engineering-organisations
Nice work @brianleroux & @ryan! 👏
Architect 6.0: Ruby, Python, CDNs, and CloudFormation https://blog.begin.com/architect-6-0-ruby-python-and-cloudformation-9a171e166258
“Testing in production is a superpower. It’s our inability to acknowledge that we’re doing it, and then invest in the tooling and training to do it safely, that’s killing us.”
I test in prod – Increment: Testing https://increment.com/testing/i-test-in-production/
Staging is totally ignoring Production
“In the process, I put together a very simple demo app which is available on GitHub...”
A simple event-sourcing example with snapshots using Lambda and DynamoDB https://theburningmonk.com/2019/08/a-simple-event-sourcing-example-with-snapshots-using-lambda-and-dynamodb/
‘[M]ore and more it seems like the cloud providers’ preferred definition of serverless is something that approximates “managed services that scale to zero.”’
Serverless: More Than Just Functions https://redmonk.com/rstephens/2018/12/14/serverless-more-than-just-functions/
RT @everyaws: AWS Okra
Available in us-south-1 https://twitter.com/everyaws/status/1169943377904844803
Production and Staging - A Series
Replying to @mweagle
Replying to @mweagle
Replying to @mweagle
(Staging clearly overprovisioned)
RT @Jowanza: Me realizing software engineers wrote software that flew astronauts to the moon and back in the 1960s and I can’t even get Pyt…
RT @angryseattle: Finally, a little sense enters the otherwise hubris-clouded brain of @HowardSchultz https://twitter.com/i/events/1169935225784164353
Replying to @QuinnyPig and @Quinnypiglet
Would like to get confirmation from her as a Cite Reliability Engineer.
Current status
https://www.safetytalkideas.com/safetytalks/three-way-communication
Replying to @mweagle
Ship it.
“🤷♀️ If it’s not clear who owns the issue, it’s you. 🤷♂️”
Replying to @_abhayshah
Friday night is when Deee-Lite Reliability Engineers start their shift.
https://open.spotify.com/track/2UVLuddklEVak5PXgC7baA?si=hJ78mxPpTtKcFxIhK69N8g
Organic chicken in styrofoam packing
Replying to @sthulb and @rchrdbyd
MFW when I realize the scope of the IAM Policy needed for a Kinesis Firehose Lambda record transformer.
Replying to @mweagle
The Jet (https://en.wikipedia.org/wiki/Jason_Terry) is not amused.
Replying to @mweagle
Disappointment going into OT
Replying to @mweagle
Wanted: something to bridge the gap from https://docs.aws.amazon.com/firehose/latest/dev/data-transformation.html to an IAM policy for a given firehose ARN.
RN that’s hidden in the Console AFAICT, which makes it tempting to just copy/paste the potentially overly broad policy.
The secure way has to be the easy way.
Replying to @mweagle
And since the transformer should be a pure function, this is doubly 🤦♂️.
There is a source (https://docs.aws.amazon.com/firehose/latest/dev/controlling-access.html) and creating those POLA policies for an arbitrary https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-kinesisfirehose-deliverystream.html is something for another day.
Replying to @vllry
👀
Replying to @vllry
Yeeaah....
I’d say that this *is* a way to use Lambda, but it seems like there are simpler topologies that eliminate the Lambda need.
eyebrow-raising++
Replying to @vllry
Exactly.
Lambda: Just because it can be done, doesn’t mean it should be done or should need to be done at all 😉
Mentally dancing around @ben11kehoe ’s https://read.acloud.guru/cloudformation-is-an-infrastructure-graph-management-service-and-needs-to-act-more-like-it-fa234e567c82 problem and not liking the options.
Replying to @jlb13
🎵 Don’t call it a comeback...
https://github.com/facebook/proxygen
Chaos Funky would be a good band name.
Replying to @robotterror
NE and CHI resident here.
It was legit. ⛈
RT @kstewart: Y’all can’t say it. That’s the rule. Period. https://twitter.com/AngryBlackLady/status/1170399202913865728
Everfresh
https://open.spotify.com/track/4GdB5M7GbwLZLouktYocFC?si=nBuiVJYcT12tP5rgXMzcfQ
Replying to @joshroppo
Interesting replies... https://twitter.com/PaulDJohnston/status/1171009992121638913
Management is not about asking people to do stuff
“To do that managers need to ask questions, not ask for work. The best question to ask is “how can I help?”.”
Golang: Are we WebAssembly Yet?
“In short, Go’s WebAssembly support seems pretty early days”
RT @dwhitena: Listen to this great conversation with @ffpaladin (#machinelearning developer at Google) about the various #ai groups at Goog…
Replying to @PaulDJohnston
It’s not savings if you’re not already doing it though.
Replying to @PaulDJohnston
Whether it’s k8s or FaaS (both will have a place), trying to satisfy and continually verify compliance along the lines of https://medium.com/fme-developer-stories/sean-treadways-concerns-of-a-single-service-fc3753da1a2f for every service + emergent system behavior is going to remain challenging.
ELI5: Black Rod
I see you, whitespace. #Python
Replying to @taraw
Same.
Replying to @benkershner
I enabled https://pypi.org/project/black/ on save, but remain nonplussed.
Replying to @amsxbg
I feel you, fellow sufferer.
Replying to @whiskersedge
Catching up, good to see iPhone 11 returning to indestructible headphone jack.
Replying to @mweagle
Related: a paper clip, paper towel, and some rubbing alcohol are helpful dongle receptacle cleaning materials.
Replying to @whiskersedge
Baggalini: The Dongle Lineup for Fall 2019
“Machine Learning can get very complicated very quickly.” https://overcast.fm/+Nvtvj5R-U
Replying to @whiskersedge
LOL
RT @cyetain: @swardley @HiredThought X: There is a talent shortage @littleidea : there is no talent shortage X: but I can’t just hire the s…
🔥 #realTalk
17 Reasons NOT To Be A Manager
Replying to @educostadev
Thx - wonder if @Pocket is forgetting to include links now?
Replying to @ReinH
Panda’s Thumb all the Technology
Replying to @pocketsupport
I think I just copy/pasted the wrong thing. #PEBCAK
Replying to @pocketsupport
So it seems that trying to share via Twitter no longer includes the original URL? On version 7.9.
🏅
“The basics is we’re going to talk about four skills: getting curious, understanding your manager and their job, building a positive relationship, and making your manager look good.”
Getting Real About Managing Up https://www.infoq.com/presentations/management-challenges/
RT @QuinnyPig: Billion dollar idea: a search engine for Google Docs.
Continuous Delivery for Machine Learning
Replying to @pocketsupport
Yes. It includes the image but not the URL. 🤷♂️
https://twitter.com/mweagle/status/1172014788404056064?s=21
Replying to @pocketsupport
Only happens when sharing a saved link that has a preview thumbnail.
👍: https://en.m.wikipedia.org/wiki/Maslach_Burnout_Inventory 👎: https://martinfowler.com/articles/cd4ml.html#TechnicalComponentsOfCd4ml
Replying to @rchrdbyd
Unexpected headline & post a bit more understandable
Replying to @hplociniczak
Wow 😱
The myth of Configcarus who was told to configure neither too much nor too little and became forever lost in the whitespace.
Replying to @edyesed
JSON & The Clusternauts?
Replying to @edyesed
I do think k8s has a solid role and it’s hard.
Ulysses and the Golden Lambda Fleece
Replying to @ben11kehoe, @NateTheFinch, @taotetek, @bryanl and @timothysc
My experience is that the system isn’t stable enough to a priori demand these constraints.
Replying to @ben11kehoe, @NateTheFinch, @taotetek, @bryanl and @timothysc
Yeah & I think that’s better as a longform.
Replying to @brianleroux
XRAY_TRACE_HEADER_REGEX 👀
Dear @SlackHQ - how can I bulk delete members?
Replying to @SlackHQ
That is extremely disappointing.
Replying to @saasbooster and @SlackHQ
It’s not a good one. Deleting those by point n click isn’t gonna happen.
Is there an API to delete pending group invites @SlackHQ ?
Replying to @SlackHQ
Thanks. Yeah, my only recourse at this point is to delete the workspace.
It’s too early for this.
I suppose deleting the workgroup is a type of dark mode.
RT @spartago2: Wrapping up templatized #serverless Kinesis Firehose transformations.
Dark mode before user management is an interesting prioritization for a communications tool.
Replying to @turgon, @VladimirVivien, @dwhitena and @dwhitena
is the expert & I have had decent luck with https://docs.aws.amazon.com/sdk-for-go/api/service/comprehend/
Replying to @mpchlets
Same.
The TouchBar is not a good idea.
Shout out to the AWS docs team for the new layout that makes the left TOC column resizable with reflow.
RT @kstewart: @mweagle Never was. The 2018 MacBook Air got it right: normal function keys + TouchID button.
Indeed.
“Pipeline is an overloaded term, especially in ML applications.”
Continuous Delivery for Machine Learning https://martinfowler.com/articles/cd4ml.html
Replying to @mweagle
“Overall, testing and quality for ML systems is more complex and should be the subject of another in-depth, independent article.”
Replying to @bradfitz
Counterpoint: Thank you
“Everything would be ok if those workflows were consistent and did not change, but this is not the case.”
How we built a tool for validating big data workflows https://engineering.klarna.com/how-we-built-a-tool-for-validating-big-data-workflows-170c196a4493
RT @spartago2: ICYMI...
Kinesis Firehose record transforms via JMESPath or RegExps w/capture groups. #serverless https://twitter.com/spartago2/status/1172905617465335808
I believe that it’s hard to build evolvable software systems and even harder to “prioritize” this on the backlog.
I also believe this helps explain the explosive growth in containers.
Replying to @techandautism
I’m only reminded of its identity crisis when I’m forced to use the laptop only and try to remember the hoops I need to jump through to change the music track.
Replying to @dougireton
Netflix frozen AMIs w/ASGs also allowed that type of independence.
Containers enable shifting responsibility between systems, but aren’t a prerequisite for that. Shifting responsibility is more collaboration, continuity, and trust.
This is much harder IME.
Replying to @whiskersedge
I’m not sure I understand how evolvable systems create lock in.
Replying to @whiskersedge
Ah, got it.
Those “but lock-in” positions are crafty like that.
Suspected their lyrics were pretty intricate.
Ayup: https://pudding.cool/projects/vocabulary/
(Also: Wu-Tang 🔥)
https://open.spotify.com/track/3jbY9X0XZcdMMGmqI6c8ys?si=pOd7i2-PRkaEKypfLaL8xg
Replying to @southpolesteve
Same.
Replying to @rchrdbyd
It feels like ML REST generation should be a thing.
Nope.
This tweet brought to you by most software errors.
Replying to @kstewart and @getoutmyheadman
Here to help...
Replying to @kstewart and @getoutmyheadman
Good call - go with the assumptions here.
“Resumes must be submitted in XML format.”
https://jobs.lever.co/scribd/503a16da-a319-42f6-9c73-ee2a6e51d331
“What does a good working relationship with your manager look like?” https://szeitlin.github.io/posts/career_skills/manager/
“In other words, a machine learning system is Model + Data + Code. And each of these can and do change. Let’s look at how those changes can occur.”
Data Versioning · http://EmilyGorcenski.com https://emilygorcenski.com/post/data-versioning/
RT @seclectech: This is a serious list. https://twitter.com/mweagle/status/1174177440614293504
Anyone using https://aws.amazon.com/fsx/lustre/ ?
WDYT?
One of the under-reported problems of working from home is when a bird flies into your office.
Replying to @edyesed
I think s/he’s recovering from his concussion.
Replying to @edyesed
Straight through the door and into the window on the other side. Not at full speed though, so I’m expecting a full recovery.
(And some 💩cleanup afterwards)
Replying to @edyesed
Full recovery! 🐦🙌
Tried to fly through the ceiling, which was of limited success, and eventually became tired so that the window was at useful height.
“Each file system is backed by NVMe SSD storage, provisioned in increments of 3.6 TiB, and designed to deliver 200 Mbps of aggregate throughput at 10,000 IOPS for every 1 TiB of provisioned capacity.”
https://aws.amazon.com/blogs/aws/new-amazon-fsx-for-lustre/
Replying to @edyesed and @netflix
Hi Hi Birdie
It is possible
Is this NewOps?
https://operatorhub.io/
The Configuration Catwalk https://twitter.com/Cptnrwrpnts/status/1167277315228864512
RT @mipsytipsy: This is a thousand percent true. Management can be deeply lonely and isolating. Your very first task needs to be pulling t…
X: It’s containerized Me:
💯 #serverless truth ⬇️
Replying to @mweagle
This podcast has @rakyll , @jboursiquot , go and #serverless
Where do I vote for episode of the year?
Replying to @edyesed
Congratulations & nice work!
“So many ops these days. GitOps. DevOps. NoOps. AiOps. CloudOps. ITOps. SecOps. DevSecOps. It’s all just sys admin to me. "
Stuff The Internet Says On Scalability For September 20th, 2019 - High Scalability - http://highscalability.com/blog/2019/9/20/stuff-the-internet-says-on-scalability-for-september-20th-20.html
“The Apache Software Foundation alone is the home of more than a dozen projects related to stream processing.”
https://www.amazon.com/Stream-Processing-Apache-Flink-Implementation/dp/149197429X
TIL https://docs.docker.com/engine/reference/commandline/commit/
is a thing.
Replying to @richburroughs
+1
Nice #serverless deck by @danilop...although 🥦🍕? 😉
https://speakerdeck.com/danilop/taking-serverless-to-the-next-level-9f479a78-4f7c-4428-bdb6-0c19ae11bc9d?slide=56
“They just rm -rfd the entire directory and then observed what broke. And then they fixed the issues one bug at a time.”
https://about.sourcegraph.com/go/valuable-lessons-in-over-engineering-the-core-of-kubernetes-kops
“I would argue that changeability is the most important feature of software to fight complexity.”
The origin of complexity - ITNEXT https://itnext.io/the-origin-of-complexity-8ecb39130fc
“Guarantees do not necessarily compose into systems.”
On Eliminating Error in Distributed Software Systems https://blog.colinbreck.com/on-eliminating-error-in-distributed-software-systems/
Replying to @danilop
💯 agree.
🍍🍕 is a travesty.
“How IAM and resource policies work and how to spot problems.” https://summitroute.com/aws_security_training/
“Surprisingly, the root cause of bad software has less to do with specific engineering choices, and more to do with how development projects are managed.”
How to Build Good Software https://www.csc.gov.sg/articles/how-to-build-good-software
Replying to @edyesed
Evergreen video
RT @edyesed: I rewatch this talk regularly, because I found myself confusing easy and simple without the reminder.
Keep the 🔪 sharp, frien…
RT @davetownsend: @mweagle That was a good read. Lot’s of key takeaways in there. One in particular, “project owners start out wanting to b…
Replying to @davetownsend
Yep. A “solution in search of a problem” never ends well.
🤗
RT @ShawnRMclean: @mweagle Wow this was very long but also a very good read. Most of the points encourage following some type of lean princ…
Replying to @ShawnRMclean
Yeah - lots of lean thinking. Glad you liked it!
Replying to @PaulDJohnston
If 🐙 sound interesting:
https://www.amazon.com/Other-Minds-Octopus-Origins-Consciousness/dp/0374227764
Replying to @launchany
Yep - maybe https://github.com/webmachine/webmachine
Replying to @robotterror
Boss: it never hurts to ask World: but it does
RT @jtimberman: Current “working with Kubernetes” status
RT @chrismunns: my reply to the HN post: https://news.ycombinator.com/item?id=21049041 https://twitter.com/newsyc100/status/1176086384182009857
This is the future I am waiting for. #FaultAllTheThings https://twitter.com/highscal/status/1176151516773834754
Wait, can you not Ctrl+F Google Doc comments?
Replying to @kstewart and @getoutmyheadman
Replying to @kstewart and @getoutmyheadman
I need to switch Target stores.
Replying to @kstewart and @getoutmyheadman
That’s awesome
After aisle 12 I’m worse than a Gremlin 😀
Replying to @kstewart and @getoutmyheadman
“This is a journey into sight and sound.”
Sir, this is the electronics department.
Replying to @chrismunns
Solid reply.
It was only a matter of time...
“Apache Camel K is a lightweight integration framework built from Apache Camel that runs natively on Kubernetes and is specifically designed for serverless and microservice architectures.” https://camel.apache.org/camel-k/latest/
The Cloud and Open Source
“In AWS engineering, we develop stuff and we operate stuff. I think the second is more important.” https://www.tbray.org/ongoing/When/201x/2019/09/21/AWS-Open-Source-People?ck_subscriber_id=566559259
🙌
Time to update those #serverless image thumbnailing apps
Starting week 2 using https://agenda.com/
Ability to link notes with Calendar entries inside the app is 👍
Rust Club https://twitter.com/MissAmyTobey/status/1176163562693152769
“Running infrastructure at this scale poses a very practical data science and ML problem: how do we give every team the tools they need to train their models without requiring them to operate their own infrastructure? "
Towards Progressive Delivery
“But it does seem we’re unearthing a new set of problems and a new set of opportunities, and I don’t feel like anyone has given it a name yet.”
Severe Truth About Serverless Security and Ways to Mitigate Major Risks
“Ok, but what about the disadvantages? Are there any pitfalls that people tend to overlook?”
Replying to @mweagle
Ugh. Pocket app still needs updating
https://hackernoon.com/severe-truth-about-serverless-security-and-ways-to-mitigate-major-risks-cd3i3x6f
Replying to @mweagle
https://redmonk.com/jgovernor/2018/08/06/towards-progressive-delivery/
Replying to @mweagle
Grrr: https://stripe.com/blog/railyard-training-models
Replying to @mweagle
https://aws.amazon.com/about-aws/whats-new/2019/09/aws-step-functions-adds-support-for-dynamic-parallelism-in-workflows/
Replying to @MissAmyTobey
Bill and Ted’s Excellent Software
RT @daiyitastic: “As tool builders, we’re gatekeepers. Every time we print an incomprehensible error msg, someone decides they’re not good…
“What makes an app smooth isn’t lack of failure, it’s accommodation of these alternate paths. Especially when people are being humans and don’t follow your instructions.” https://blog.jessitron.com/2019/09/23/a-lot-of-rules/
“Management books are mostly not for actual managers.”
Do we need tech management books? https://vicki.substack.com/p/do-we-need-tech-management-books
Yep: “Best practices aren’t really a knowable thing.” https://www.verica.io/top-seven-myths-of-robust-systems/
Potential : Kinetic :: Software : Service
Replying to @tmclaughbos
Helpful guide for one of those audiences: https://www.amazon.com/Seat-Table-Leadership-Age-Agility/dp/1942788118
Replying to @ben11kehoe
Thanks! I caught myself saying “inert software” at some point and was wondering how much that made sense.
Communication and collaboration are often used interchangeably.
Replying to @systemalias
True enough 😉
TIL: Tuple25 is a thing.
Replying to @dmainf
Flink
Replying to @dmainf
In all it’s markup glory:
https://ci.apache.org/projects/flink/flink-docs-release-1.8/api/java/org/apache/flink/api/java/tuple/Tuple25.html
Use Your Illusion of Control
Mapping all the things with AWS Step Function is shaping up.
https://states-language.net/spec.html#map-state
Replying to @tmclaughbos and @rmn
Nope
The Horror
Replying to @mweagle
The Sequel
Replying to @skpodila
Shout out to the @Apple lightning port that no longer charges or outputs audio through the sleek dongle.
But wow, that longer battery life I can’t use.
“In just 50 days, you’ll understand the basics of Kubernetes...”
https://azure.microsoft.com/mediahandler/files/resourcefiles/kubernetes-learning-path/Kubernetes%20Learning%20Path%20version%201.0.pdf
“Ultimately, the valuable use cases for AI involve complex, messy problems...”
https://derwen.ai/s/yvkg#0