Replying to @whiskersedge
True. Hoping he does well, but I’ll miss his collegiate transcendence.
Still true. https://twitter.com/mweagle/status/1101627748026478592
Replying to @whiskersedge
Yep & more power to him. Still excited to watch him play & grow, and expecting some tremendous transition highlights. I will miss the blindside in the paint blocks as he’ll be more often standing in the corner covering the other team’s 3.
Analytics-floor spacing 😞
RT @copyconstruct: Very first stab at a comparison between AWS lambda, Cloudflare Workers and Fastly’s new wasm based runtime.
I started…
WIP RIP
Replying to @chrismunns
RT @ceejbot: Engagement is a toxic metric.
https://twitter.com/MikeIsaac/status/1113166008712224768
✅ Bucket list trip
iOS Chrome link ➡️ Medium app ➡️ Safari
“From the practical example, it seems that Prophet provides completely automated forecasts just as its official document states.” (via @Pocket) #longreads https://towardsdatascience.com/a-quick-start-of-time-series-forecasting-with-a-practical-example-using-fb-prophet-31c4447a2274
Replying to @ryan_sb, @alexbdebrie, @robotterror, @tmclaughbos and @ben11kehoe
‘get clone’
Flying metal tubes make excellent conditions for getting sick.
Replying to @Adron
Thx. At least it happened on the return flight.
In the sky I can only assume there is a lost dongle drawer right beneath the lost sock drawer.
This tweet brought to you by the thinest, most USB-C enabled MBP ever.
Replying to @perrito666
Agree & that has been super helpful. I was moving things around (never a good idea) and the ~4" dongle for the ~0.5" USB plug and misplaced the the dongle along the way.
2019 shaping up to be the Year of Linux on the Desktop.
Replying to @perrito666, @ramyanexus and @code
I would also like to add my feedback.
Your work is awesome @ramyanexus. I have not enjoyed an editor this much for years either.
Thank you for making @code so tremendous.
Default status
Great example of how metrics generally aren’t enough. Nothing about “talking” on the scoreboard.
‘In the Kill Drill, Adams considers any defensive breakdown cause to restart the clock. “If you’re not talking, he says ‘OK, start it over,’” Mooney said.’
https://www.theringer.com/march-madness/2019/4/3/18293467/chris-beard-texas-tech-jarrett-culver-final-four-defense
Today’s accomplishment
RT @skamille: What is it with functional programmers and the belief that if we just had the right computing paradigm everything would be or…
Is this still a thing?
https://www.holacracy.org/
RT @kstewart: Nope. https://twitter.com/mweagle/status/1113599663620468736
Pipelines are coming, a thread...
- https://github.com/features/actions - https://docs.microsoft.com/en-us/azure/logic-apps/logic-apps-workflow-definition-language - https://states-language.net/spec.html - https://www.commonwl.org/user_guide/02-1st-example/index.html - https://concourse-ci.org/pipelines.html
Replying to @mweagle
- https://docs.gocd.org/current/configuration/pipeline_templates.html - https://docs.travis-ci.com/user/job-lifecycle/#the-job-lifecycle - https://jenkins.io/doc/book/pipeline/#declarative-pipeline-fundamentals - https://www.kubeflow.org/docs/pipelines/pipelines-overview/ - https://en.wikipedia.org/wiki/XProc
Replying to @mweagle
- https://docs.microsoft.com/en-us/azure/devops/pipelines/get-started/what-is-azure-pipelines?toc=/azure/devops/pipelines/toc.json&bc=/azure/devops/boards/pipelines/breadcrumb/toc.json&view=azure-devops - https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-codepipeline-pipeline.html - https://docs.aws.amazon.com/codebuild/latest/userguide/build-spec-ref.html#build-spec-ref-syntax - https://beam.apache.org/documentation/pipelines/design-your-pipeline/ - https://github.com/argoproj/argo
Replying to @mweagle
I don’t know much about the k8s world, but I’m guessing there are more examples over there.
Know of more? Anyone have any favorites?
Replying to @edyesed, @adamhjk and @sogrady
Same. Observability and Security are often paygated and knowing that is enough to make me look elsewhere.
Replying to @Jowanza
Too real in the PNW
https://youtu.be/ZvuGpAI1AfI
Suggestions for distributed team Sprint retrospective anonymous feedback/virtual whiteboard tools?
RT @acvisneski: #nocontext
This is a great group & an excellent space to talk about difficult topics. Recommended. https://twitter.com/seacoffeeops/status/1113631690113437697
Replying to @mweagle
More curated lists: - https://github.com/meirwah/awesome-workflow-engines - https://github.com/pditommaso/awesome-pipeline
Replying to @mpchlets
Yep. This is the true and singular pipeline problem.
Replying to @evntdrvn and @goReflect
Thx - looking into it.
Nice work by @windlessuser: a @goserverless microservice Twitterbot. 👊
https://www.useloom.com/share/45ce865f9ecc4d6fa51f581b42286359
Really?
Props to me for not Tweeting that.
Replying to @kstewart
/matt is not supported in Slack. Sorry, not sorry.
Wanted: poster-size version of this Tweet. https://twitter.com/skamille/status/1113951547153625088
Replying to @mweagle
Close:
https://framedtweets.com/products/custom?url=skamille/status/1113951547153625088
Please unroll @threadreaderapp https://twitter.com/skamille/status/1113951176754647045
“Next time you find yourself Googling some cool new technology to (re)build your architecture around, I urge you to stop and follow UNPHAT instead” (via @Pocket) #longreads https://blog.bradfieldcs.com/you-are-not-google-84912cf44afb
“I focus on a few broader aspects of data science: definining methodologies, dealing with uncertainty, building pipelines, and fostering a culture of machine learning.” (via @Pocket) #longreads https://medium.com/@neal_lathia/five-lessons-from-building-machine-learning-systems-d703162846ad
“The data science hierarchy of needs is not an excuse to build disconnected, over-engineered infrastructure for a year.” (via @Pocket) https://hackernoon.com/the-ai-hierarchy-of-needs-18f111fcc007
“I discovered that the majority of the growth of cockroach over time is concentrated in one object, runtime.pclntab.” https://science.raphael.poss.name/go-executable-size-visualization-with-d3.html
“Source Code Is Not the Real Value” (via @Pocket) #longreads https://redmonk.com/sogrady/2019/04/02/chefs-different-recipe/
Cool idea @ml4all
‘I and group of like-minded friends decided to organize a community conference about machine learning “for the rest of us”’(via @Pocket) https://dev.to/lenadroid/making-machine-learning-approachable-7ap
🧐
“Your project is compiled to a WebAssembly module and run in the browser.” (via @Pocket) https://www.vugu.org/doc
Who ordered the grande wackachino? https://twitter.com/ndrew_lawrence/status/1113940594013954049
I often wish the Netflix projects only used AWS infra primitives. https://netflix.github.io/conductor/configuration/workflowdef/
“You can select up to four D-series cores and 14 GB of memory.” (via @Pocket) https://azure.microsoft.com/en-us/blog/announcing-the-azure-functions-premium-plan-for-enterprise-serverless-workloads/
“We’re beginning to see the tool suits that provide the features that machine learning engineers need...” (via @Pocket) https://www.oreilly.com/ideas/specialized-tools-for-machine-learning-development-and-model-governance-are-becoming-essential
“Processing the samples on up to 32,000 AWS cores took 90 hours of wall time, 368,000 jobs and 1,325,936 core hours.”
https://www.biorxiv.org/content/biorxiv/early/2016/07/07/062497.full-text.pdf (via @Pocket)
Replying to @mweagle
Sickness fever take: implementing a #serverless version of toil with Fargate/ec2 spot, Step functions, and Lambda would be a cool project.
Replying to @turgon
/cc @landongn https://twitter.com/dgryski/status/1114019847032074240
“We’re going to learn how to estimate the durability guarantees of a storage system.” (via @Pocket) https://medium.com/@jamesacowling/how-many-nines-is-my-storage-system-7d16e852d56d
Trying to get a handle on the distributed pipeline/DAG/workflow space is a good counterbalance to the no/lowcode trend.
Replying to @tmclaughbos
The dream of the 70s is alive in Cloudlandia
Replying to @AmiramShachar
Thx. I only skimmed it, but didn’t see a workflow engine/programming model. Am I missing it?
Replying to @tmclaughbos
FWIW, I’ve switched to https://magefile.org/ to support xplat https://gosparta.io builds.
Replying to @brianleroux
And confirms that management is a verb.
RT @monkchips: huge congratulations to our friends over at @451Research. this is an epic achievement. that’s a *lot* of clients served. als…
RT @helenhousandi: Imagine reading Tech Twitter and still thinking women are the “overly emotional” ones
Replying to @robotterror
Umm...
Echoes of Grandmaster Flash in https://open.spotify.com/album/42yEC12mg5VWXsNn4PgCvn?si=X7EdbygbRKeU3c4grgBrmg /ht @aneel
Replying to @robotterror
Replying to @perrito666
My bad.
cylc’s (https://cylc.github.io/) approach to configurable workflow parameterization: https://cylc.github.io/BoM-Feb-2017/index.html#73.0
Hmm....
“Cascading local mode can be used in constrained and lightweight environments like AWS Lambda.”
https://www.cascading.org/2017/09/22/cascading-4-for-streaming-with-amazon-s3-and-apache-kafka/
Layers: Desired vs. Actual
Will read the whole paper, but interest in intro mentioning “proper formal foundation”, somewhat tempered by the next chapter starting with “a java-based Editor desktop application”.
http://www.yawlfoundation.org/manuals/YAWLUserManual4.0.pdf
“At scale...every state is reached.”
https://vimeo.com/302574884
Replying to @catehstn and @Pocket
Thank *you* for sharing it. Really enjoy your writing and rooting for you.
And while I have much respect for raccoons, not quite as keen on them though. 😉
Replying to @edjgeek, @PaulDJohnston, @FarrahC32, @tmclaughbos and @stackeryio
Dr Pepper is for when the only other option is La Croix Coconut.
This made for an excellent Friday.
https://open.spotify.com/album/42yEC12mg5VWXsNn4PgCvn?si=2BoUVYqcRyOEcjejcBYs0A
Replying to @dbsmasher
Artificial Income?
MFW the static site now renders improperly.
Narrator: it was not really static.
RT @lenadroid: I’m so happy with this year’s fascinating speaker lineup and a variety of topics you will hear about at @ml4all.
❤️ About @…
Replying to @southpolesteve
Tru dat.
I want to like https://github.com/knsv/mermaid, but it sure does seem finicky.
Replying to @ben11kehoe
The Sound of One Hand Waving
“In contrast to a static algorithm coded by a software developer, an ML model is an algorithm that is learned and dynamically updated.” (via @Pocket) https://cloud.google.com/blog/products/ai-machine-learning/making-the-machine-the-machine-learning-lifecycle/
“Best practices in deploying HPC resources on AWS include creating much of the infrastructure on-demand, and making it as ephemeral and dynamic as possible.” (via @Pocket) https://aws.amazon.com/blogs/compute/deploying-a-burstable-and-event-driven-hpc-cluster-on-aws-using-slurm-part-1/
Replying to @whiskersedge and @Pocket
IaC in various forms has been around for a while now though. I’m guessing it’s going to take more drill downs like the one you did before it’s common practice though.
What are you using to manage it? Would like to hear more.
Finally playing around with https://github.com/awslabs/goformation.
Props to @paulmaddox & all the contributors: https://github.com/awslabs/goformation/graphs/contributors
Replying to @paulmaddox
Great! I can only guess how much “fun” it was to come up with https://github.com/awslabs/goformation/blob/master/generate/templates/polymorphic-property.template 😉
It’ll take some time, but looking forward to migrating to your lib. 🙇♂️
😂
“1154 results in 82 files”
Next exit from Migration Highway in 142 hours.
RT @lindydonna: I’ve been employed for over 10 years at many top companies, and I have one simple rule for hiring managers. If you “liked”…
RT @ben11kehoe: This is a neat paper: Lambda = high parallelism cheaply, at the cost of lower predictability. Unlock effective algorithms b…
X : we make data-driven decisions Me: what counts as data? X: complying with tacit social, exclusionary rituals unrelated to actual professional responsibilities Me: yeah, no. https://twitter.com/jessicaliebman/status/1114160523581501440
Replying to @whiskersedge and @Pocket
Thank you for that 😀
Replying to @whiskersedge and @Pocket
Are you evaluating AWS to complement Azure?
RT @brianleroux: Incredibly useful, community maintained type definitions…
https://github.com/DefinitelyTyped/DefinitelyTyped/blob/master/types/aws-lambda/index.d.ts
…for nearly all possible AWS Lambda i…
Replying to @brianleroux
Word.
JSONScehema/protobuf/DDL schema for AWS payloads. #awswishlist
Replying to @mweagle
Equating data-driven with “value neutral” is tempting and inappropriate.
“Sometimes this 💩 is f’d but nobody wants to say it.”
@jessfraz FTW 👊 https://overcast.fm/+RMBwMkr9Y
You can’t do the right thing if there isn’t a space where people feel comfortable saying we’re doing the wrong thing. https://twitter.com/mweagle/status/1115271766203461632
Replying to @edyesed
Stay safe and get those pogies warmed up.
Do you have thoughts about a #serverless feed design with API-G, SQS, other?
https://serverless-forum.slack.com/archives/C1GETBAT0/p1554743174008800
Replying to @jbesw, @chrismunns, @edjgeek and @virgilvox
Yay!
RT @mweagle: The most insidious lock-in isn’t technological.
It’s the limiting beliefs perpetuated by a person, a team, or an institution.
Replying to @skpodila
Yes please and not soon enough.
RT @skpodila: Can we all acknowledge that we just move from one “lock-in” to another? There is no approach that liberates you from you “lo…
The kind of teammate you want: @PatrickMahomes
Game time
This seems useful
https://docs.aws.amazon.com/batch/latest/userguide/batch-cwe-target.html
Keep it up, Squirt. https://twitter.com/mweagle/status/1115466461240152064
Replying to @realDavyHua
Yep & related: “A good litmus test has been that if you need to SSH into a server or an instance, you still have more to automate.”
https://www.allthingsdistributed.com/2016/03/10-lessons-from-10-years-of-aws.html
TIL a bit more about Apache Beam https://overcast.fm/+E_eME3LAo
Understandable step:
“Cloud Run is introducing a brand new product that takes Docker containers and instantly gives you a URL”
https://techcrunch.com/2019/04/09/google-cloud-run-brings-serverless-and-containers-together/
I’m always leery of “hands-free automigration” promises, but it is good to see GOOG trying to meet customers more where they are:
“This service will auto-migrate VMs from on-premises or other clouds into containers in the Google Kubernetes Engine.”
https://techcrunch.com/2019/04/09/googles-anthos-hybrid-cloud-platform-is-coming-to-aws-and-azure/
RT @jboursiquot: When I hear the words “cloud”, “VM”, and “automigrate” in the same sentence. #WeWillSee
Can’t argue with science.
La Croix Coconut < Squirt https://twitter.com/mweagle/status/1115466461240152064
Replying to @edyesed
I tried it...once.
It’s like a teaspoon of coconut suntan lotion mixed with carbonated water.
Flip the Script as a Service
Replying to @rchrdbyd and @edjgeek
I think we both know what’s in this mug. 😉
🧐 Many #serverless pitches emphasize the short dev loop for Day One. Would they look different if they were more biased towards Day Two problems? https://twitter.com/RealGeneKim/status/1115791619171782659
RT @jeremy_daly: Issue #32 of Off-by-none is out! This week we’re live from @serverlesscon, we wish @jbesw good luck @awscloud, and w…
👊 & 🙇 https://twitter.com/NBA/status/1115786567640076288
👊 & 🙇 https://twitter.com/MiamiHEAT/status/1115759701604687872
RT @kstewart: I’m adding The Making of a Manager by @joulee to my list of recommended reads for engineering leaders.
Excellent and enjoya…
“[M]ost importantly, all the tools were naturally aware of the application’s entire context.” (via @Pocket) https://medium.com/garden-io/rails-in-the-age-of-kubernetes-8c6a866ebe18
“But there has been no unified API that binds all these frameworks and data sources, and provide an abstraction to the application logic from big data ecosystem.”“
Apache Beam: Headstart for a beginner” by Nagesh Singh Chauhan https://link.medium.com/yKaXLKPrLV
The streaming/ML pipeline world is...vibrant.
RT @lhochstein: Tired: changing the architecture of software systems.
Wired: changing the architecture of people’s mental models.
Replying to @hichaelmart
Many would, but I’d run towards it. 😉
Replying to @rchrdbyd
I don’t know how to feel about the Dr.’s victory, but I hope we can find common ground with La Croix’s performance.
Replying to @JoeEmison, @ben11kehoe and @MrAlanCooper
I would like to read more on this. Suggestions for reading more about @MrAlanCooper ’s take?
The specific protocol is much less important than the constellation of domain functionality, the delegation of operational responsibility, and the statelessness forcing function.
Replying to @brianleroux, @PaulDJohnston, @IamStan, @ben11kehoe and @jeremy_daly
Is AWS Batch an option?
Replying to @brianleroux, @PaulDJohnston, @IamStan, @ben11kehoe and @jeremy_daly
Might need EC2s (Fargate?), but worth TAL: https://www.youtube.com/watch?v=T4aAWrGHmxQ
Replying to @JoeEmison, @ben11kehoe, @MrAlanCooper and @jessitron
Thx - added to queue.
Big @jessitron fan & https://www.greaterthancode.com/ is a favorite podcast.
Replying to @rchrdbyd, @edjgeek and @tmclaughbos
I’ve found this helpful:
1. Start with Why 2. Agree on What 3. Creative Friction on How 4. Decide on Who
Go.
Replying to @mweagle
It’s rarely this straightforward, but IME it’s pretty hard to get agreement on How before everyone has a common understanding of What.
Replying to @mweagle
This requires being transparent about the objectives you have in mind and the tradeoffs you’re willing to make with the illusion of foresight you’re working with.
There will be other tradeoffs that only emerge after part of the journey has been made and that’s just how it goes.
Tired: waiting for requests
Wired: creating consumers in response to requests
Inspired: eliminating requests
Narrator: the guy who wrote it is awesome. https://twitter.com/mindstorms6/status/1116117553862995968
Yeah, that.
If you conduct or participate in Incident Reviews I’d encourage you to listen to this one episode.
Like, right now 😀 https://overcast.fm/+EODNoRe5A
Me: I need to get up early tomorrow. I should set an alarm.
Brain: don’t need an alarm if we don’t ever sleep.
Replying to @mpchlets
Ugh - that’s super frustrating. When I start to think about the sleep I’m not getting it makes it harder for me to fall asleep.
If you liked the Berkeley #serverless paper, I’m guessing you might like this. https://overcast.fm/+D0nHMQ-UE
Replying to @mpchlets
I’m going to try this visualization next time.
RFC: what declarative workflow specification do you like the most? Even like a little?
Replying to @ben11kehoe
That’s cheating 😉
Replying to @ben11kehoe
This escalated SWFly
JSON all the things is giving me “XML is a good choice for Ant” flashbacks.
Replying to @ben11kehoe
Well played
I still like the X** stack. Don’t @ me.
Related: currently reading https://jsonnet.org/
Replying to @brianleroux
Unpopular opinion: XSLT is great 😀
Replying to @brianleroux
It hurts because it’s true.
Replying to @brianleroux
Good to hear @serverl0ss & welcome to the cloud party!
I short circuited the 5 Why’s RCA and just cut to the chase with my 1 Why:
Because there is something and not nothing.
“This package lets you define programmatically workloads for AWS Elastic Map Reduce (EMR) clusters and Lambda functions using Python with a concise methodology aimed at fast prototyping.” (via @Pocket) #longreads https://github.com/elehcimd/awsflow
“A survey was conducted asking employees what they wanted most from work. Overwhelmingly, the answer was: trust me with my time, trust me to do my job, and I’ll deliver results, and be a happier employee too.” Results-Only Work Environment (ROWE) https://workplacepsychology.net/2017/01/04/results-only-work-environment-rowe/
There is too much goodness in this post to pick just one quote.
Conference Report: SRECon Americas 2019 (via @Pocket) #longreads https://noidea.dog/blog/srecon-americas-2019
Data is the next difficult problem. https://overcast.fm/+FyQ8xfuX8
You can buy Agile on Aisle 6, right next to The DevOps. https://overcast.fm/+HW1C-L6qQ
All 29 AI announcements from Google Next ‘19: the smartest laundry list (via @Pocket) https://cloud.google.com/blog/products/ai-machine-learning/all-ai-announcements-from-google-next19-the-smartest-laundry-list/
“All this is to say that Cloud Run should not be seen as equivalent, or even analogous, to pure FaaS; Cloud Run fundamentally involves significantly more code ownership.” (via @Pocket) https://medium.com/@ben11kehoe/the-good-and-the-bad-of-google-cloud-run-34455e673ef5
“CloudRun can be operated in two different modes, the first one is fully managed while the second one can be operated on your “own” GKE cluster.” (via @Pocket) https://dev.to/mstrsobserver/first-steps-with-google-cloud-platform-cloudrun-41o
“Toolkits like Kubeflow really reinforces the dream where running AI tasks and serving them is not just limited to a handful of organizations but it is easily accessible to everyone.” (via @Pocket) #longreads https://medium.com/kubeflow/why-kubeflow-in-your-infrastructure-56b8fabf1f3e
Mortal Engines movie: not a fan
Replying to @edyesed
Atrocious
Moving from Project ➡️ Product
Taking Serverless to the Next Level (via @Pocket) https://speakerdeck.com/danilop/taking-serverless-to-the-next-level-4e03cdc6-bdf8-4fc8-880a-cafcf8d6eca1
Step 1️⃣
“Make sure your pipeline is solid end to end.” (via @Pocket) #longreads https://developers.google.com/machine-learning/guides/rules-of-ml/
Replying to @mweagle
Put things in place with the expectation that you will need to get better at getting better.
Replying to @UpOscarTech and @Pocket
Yes & many projects live longer than expected (or desired) 😉
Replying to @KevinGoldsmith
Same.
Replying to @em__shea
It seemed like there could have been a good story in there somewhere.
Replying to @kstewart
“In a passing generation, I am a remainder”?
RT @gwenshap: @cmeik @QConAI Using CRDTs to drive stateful apps to the edge (perhaps avoiding central DBs entirely) is something we aren’t…
Make my (Sun)day
Still on track to make https://www.52hikechallenge.com/
Replying to @ben11kehoe, @gwenshap, @cmeik and @QConAI
I am very much looking forward to our event-based, CRDT future.
Replying to @chrismunns
Yes, but only if you can find the tab that has the reward. 😀
Is TabBarZero a thing?
How many hours have been lost from everyone undoing the formatting brought along by copy/paste?
Replying to @kstewart
YAY!
tyvm. 🙇♂️
Replying to @JimmyMerritello
Same. I need a `gofmt` for Google Docs.
How often have I said to you that when you have eliminated the known unlikely failures, whatever remains, however improbable, must be the happy path?
- Cloudlock Holmes
MFW the docs suggest I “log in to my EC2 instance”
✋ Doing that right now https://twitter.com/jessfraz/status/1117577050045292545
The complexity came from inside the problem.
Montrezl is 👌
#GSWvsLAC
Supporting different environments is always work. Full stop.
“Due to kubeflow/pipelines#345 and kubeflow/pipelines#337, Kubeflow Pipelines depends on Google Cloud Platform (GCP) services and some of the functionality is currently not supported by non-GKE clusters.”
GTK it’s possible and it seems like it could be streamlined?
Starting a State Machine Execution in Response to Amazon S3 Events - AWS Step Functions https://docs.aws.amazon.com/step-functions/latest/dg/tutorial-cloudwatch-events-s3.html
Want to learn more about how we make data discoverable at @lyft? https://overcast.fm/+E_eNdHIXg
My favorite part about the new MBP is the boundless excitement I feel every time I plug the USB-C cable for the external monitor and wait to see if the display will be detected. #MBP20154Lyfe
Replying to @edyesed
Good idea.
It’s not a good product.
You are not your code. https://twitter.com/glitch/status/1118219279726411778
Replying to @QuinnyPig
FrankenFlavors must be stopped.
RT @nathankpeck: Is there a tracing or observability feature you’ve always dreamed of having?
What could help you find bugs and performanc…
Replying to @robotterror
AWS CageMaker
“About a third of the impact was triggered by changes.”
Incidents — Trends from the Trenches – Subbu’s Blog https://m.subbu.org/incidents-trends-from-the-trenches-e2f8497d52ed
Hey, where is this awesome new “data dump” I heard about?
Conway’s Law: Endgame
Replying to @tammybutow, @GremlinInc and @richburroughs
Nice! Sending public speaking support 👊
Updating JIRA on a 2018 MBP
AMA.
Replying to @rdodev
I’m struggling to decide which one I like “more”.
Replying to @benkershner
I’ll file a ticket to find out, but I can’t find the “Create” button because it’s on the external monitor that won’t power up over USB-C.
Replying to @aneel
I hope so.
Replying to @aneel
Sending you freelance Cambrian vibes.
Everything is event based. https://overcast.fm/+GoogaA-UU
Replying to @salman_paracha, @forrestbrazeal, @rchrdbyd and @serverl0ss
Ohhh, will have to revisit 😀
“AWS Step Functions turned out to be a good fit for the data pipeline use case as it comprises long-running steps.” (via @Pocket) https://tech.olx.com/building-an-aws-serverless-ml-pipeline-with-step-functions-b39feed12bab
“I have learned to never underestimate the value of you regularly and visibly spending your personal and time and focus on an area motivating your time to find it interesting and worthwhile.” (via @Pocket) #longreads https://medium.com/@inowland/management-area-1-engineering-8d6d9da1ee7c
“The second is something we’ve said about all manner of things in software engineering: we need to improve representation.” (via @Pocket) #longreads http://willgallego.com/2019/04/17/peering-into-the-future-of-resilience-engineering-in-tech/
Tragic. PowerPoint is a poor medium for understanding.
“This, however, is the story of a PowerPoint slide that actually helped kill seven people.” Death by PowerPoint: the slide that killed seven people (via @Pocket) https://mcdreeamiemusings.com/new-blog/2019/4/13/gsux1h6bnt8lqjd7w2t2mtvfg81uhx
“The main source of intrigue here is the desire to stay gainfully employed in the future - if we aren’t going to need OPS engineers in our glorious future, I’d like to see what all the fuss is about.” /cc @tmclaughbos (via @Pocket) #longreads http://www.leebriggs.co.uk/blog/2019/04/13/the-fargate-illusion.html
“There are a few reasons why for these types of decisions, a document review is preferred to Powerpoint:” (via @Pocket) #longreads https://medium.com/@inowland/using-6-page-and-2-page-documents-to-make-organizational-decisions-3216badde909
DORA is 💯
“It’s fair to say, Dr. Nicole Forsgren, Jez Humble and Co. have successfully collected more data on software team behaviors than anyone else in the world.” (via @Pocket) https://www.stackery.io/blog/future-of-serverless/
😢 “When scheduler is stuck for whatever reason, all you see in web UI is all tasks are running, but in fact they are not actually moving forward while executors are happily reporting they are fine.” Workflow Processing Engine Overview 2018 https://xunnanxu.github.io/2018/04/13/Workflow-Processing-Engine-Overview-2018-Airflow-vs-Azkaban-vs-Conductor-vs-Oozie-vs-Amazon-Step-Functions/index.html
“I found myself knee deep in a story that dates back to the Cold War and involves the US Navy, ship radar and a statistician named Leo Breiman.” The Impossible Artificial Intelligence Problems of the Cold War (via @Pocket) #longreads https://www.codebeast.dev/impossible-artificial-intelligence-problems/
Replying to @copyconstruct
Current status
Replying to @jeffbarr
“Is #catless a thing yet?”
This day.
WWKD: What Would @kstewart Do?
Tinder’s move to Kubernetes (via @Pocket) #longreads https://medium.com/@tinder.engineering/tinders-move-to-kubernetes-cda2a6372f44
“Instead, figure out which tasks have the highest uncertainty – those tasks are basically going to dominate the mean time to completion.” (via @Pocket) https://erikbern.com/2019/04/15/why-software-projects-take-longer-than-you-think-a-statistical-model.html
“I have seen that the best teams have one thing in common: a strong team culture.”
How to Create a Great Team Culture (and Why It Matters) (via @Pocket) #longreads https://queue.acm.org/detail.cfm?id=3323993
“[E]ngineers who are literate in data science and machine learning, who understand how to deploy and run systems in production, and who are up to the challenges of supporting machine learning products.”
https://www.oreilly.com/ideas/what-are-machine-learning-engineers
RT @turgon: @mweagle @Pocket there’s some good and bad in this. but man am I ever glad to see people exploring it
Congratulations to everyone @ @fastly
One thing I repeatedly encounter is that one system’s metadata is another system’s data.
Replying to @mpchlets
truth
Mos def like this metaphor more than pipelines. https://twitter.com/Blacky_Himself/status/1105608870205050882
Replying to @mweagle
/ht @highscal
JIRA: not a fan
Replying to @mweagle
Column management view shows the cards I want to display.
Switch to main view.
No cards visible.
wat.
Replying to @kstewart
I still have much to learn from your JIRApertise. 🙇♂️
Shout out to the @lyft employee who pointed me to https://marketplace.atlassian.com/apps/34717/structure-for-jira-projects-at-scale?hosting=cloud&tab=overview and walked me through it.
Things already looking much better.
I think I have achieved a temporary state of JIRAlightenment and things are back on track. Need to document the workflow, but that can wait until next week.
Replying to @QuetzalliAle and @amcasari
Definitely
RT @FrancescoC: It is with great sadness that I share news of Joe Armstrong’s passing away earlier today. Whilst he may no longer be with u…
RT @rakyll: Joe Armstrong had a huge influence on me as a programmer. It is painful to see him go but his ideas will stay with us for a lon…
I never met @joeerl but he had a huge impact on me and many others. His voice and work was humble, curious, and brilliant. Sending thoughts to his family. #rememberingjoe
Same & +💯 for re-reading. IC’s likely to benefit from reading as well. https://twitter.com/erikaybar_/status/1119627440861646850
Of course.
“[S]tudents...fail to appreciate the need for some degree of up-front design. (Of course, we never make that mistake in industry;) ).” (via @Pocket) #longreads https://blog.acolyer.org/2019/04/17/teaching-rigorous-distributed-systems-with-efficient-model-checking/
Reading a physical book is a different type of experience than reading digital. Hard to post quotes and bookmark bitly links though.
Not impossible, but improbable
Replying to @kstewart
Yeah, like it so far.
I’m guessing I only knew about it from an earlier endorsement you tweeted. 😀
Replying to @seclectech
You bet! About halfway through & like it so far - structured, pragmatic, and D&I aware.
Replying to @KevinGoldsmith
I was manually entering bitly links yesterday.
Replying to @ben11kehoe and @vladusenko48
Yeah. I can see how this could be a side effect, but I don’t think it’s the point of serverless.
Replying to @JoeEmison
Replying to @vladusenko48 and @ben11kehoe
Agree about the forecast estimates 😀 I don’t read your remark in that way & would like to read more about what you’re working on.
Replying to @PaulDJohnston and @JoeEmison
Not now, not ever
Replying to @seclectech
I’m there now.
Yep
People first, then process, then technology https://twitter.com/hillelogram/status/1119709859979714560
It’s @DevOpsDaysSEA week!
https://www.devopsdays.org/events/2019-seattle/welcome/
Replying to @tmclaughbos
What does @ben11kehoe think about this?
Please unroll @threadreaderapp https://twitter.com/norootcause/status/1120478413863772162
“You never know when in the future you will draw upon what you’ve learned to make a better decision.”
Thread by @lhochstein: “Learning from incidents, let’s talk specifics!” https://threadreaderapp.com/thread/1120478413863772162.html
Replying to @richburroughs and @mtnygard
Great book
Saving the best for last
Replying to @mweagle
“Effective communication doesn’t just happen.”
This is a good book and the final chapters on communication *specifics* as well as the dimension/warning signs/corrective action table deserve extra props. Recommended.
https://medium.com/scaling-teams
What if the real lock-in is the reluctance to commit?
Replying to @ewindisch, @ben11kehoe and @tmclaughbos
Are systems designed to avoid lock-in concurrently implemented in multiple languages?
Not news, but Giannis is really good. https://twitter.com/bballbreakdown/status/1120496494543552513
Replying to @edyesed
Look forward to seeing you all there! 👋 https://twitter.com/IOpipes/status/1120711421669588992
Replying to @slobodan_
I haven’t read it yet & apologies if I have crossed any streams. 🙇 Your take seems very pragmatic and reasonable to me. Would like to read in full.
RT @slobodan_: @mweagle No, no, I just guessed that it created a bit of a misunderstanding 😃 Which is also fine, as it was an experiment. B…
“Gaia requires no YAML/JSON or any other configuration spec to write automation workflows.”
https://gaia-pipeline.io/
Replying to @evanderkoogh
Truth
Replying to @Jowanza
Tremendous
Dame 2020 #DAMETIME
Replying to @Jowanza
Also, a *really* bad shot to take there 😂
Looking forward to the Dame version of this.
http://devopsreactions.tumblr.com/post/87284390953/friday-deployments-and-leaving-afterwards
Replying to @Jowanza
Exactly. High pick and roll is boring 😉
Coach: “No, no, no...YES!”
Not a good shot.
A great outcome though. https://twitter.com/Ballislife/status/1120921060747227136
RT @timbray: @jboner @obie The space is cool because we’re still figuring out conventional wisdom and best practices. DX in particular.
Replying to @forrestbrazeal, @lynnaloo and @Trek10inc
Calling all #go #serverless users #golang https://twitter.com/golang_news/status/1121126125231661060
/cc @tmclaughbos https://twitter.com/sarah_shewell/status/1121122274411565056
@edyesed s GIF game is Olympics worthy https://twitter.com/sntxrr/status/1121124815731974144
RT @edyesed: These tools are great, but they’re going to get in your way of dealing with organizational scar tissue and getting to The Trut…
Replying to @edyesed and @botchagalupe
✊
“If a man asks me for my loyalty...I will give him my honesty. If a man asks me for my honesty...I will give him my loyalty!”
-John Boyd
“You can also instruct CloudFormation not to delete a resource at all.”
6 unknown CloudFormation features you should know about (via @Pocket) https://cloudonaut.io/6-unknown-cloudformation-features-you-should-know-about/
“Our experience was that it was difficult to coordinate efforts at scale.”
Management and Organization at Medium (via @Pocket) https://blog.medium.com/management-and-organization-at-medium-2228cc9d93e9
Replying to @mweagle
it == Holocracy
“You might blame each other for the current problems or snafu, but it’s really the lack of shared vision that’s the offender.” (via @Pocket) https://marlagottschalk.com/2014/03/10/blamestorming-and-other-telling-signs-your-organization-is-still-siloed/
RT @jrhunt: @chrismunns I hope I’m not one of those!
But have you noticed how offended people get when you try to tell them to have better…
Replying to @chrismunns
Chat is the open floor plan of mind
Solid 👇
“I explain the concept of the null process, how it can hurt companies, how it can hurt diversity, and ideas for putting in place good process.” (via @Pocket) #longreads https://kateheddleston.com/blog/the-null-process
This is disappointing
Adapt
https://www.amazon.com/Seat-Table-Leadership-Age-Agility/dp/1942788118
Replying to @mweagle
“Agile delivery is existentialist IT.”
Replying to @wickett
Yeah, too quickly 😕
“Good management is about managing learning; that is, about doing things that generate information that will help inform decisions.”
A Seat at the Table: IT Leadership in the Age of Agility https://www.amazon.com/dp/1942788118/ref=cm_sw_r_cp_api_i_9kCWCb5MVRZ2Z
RT @tmclaughbos: If you’re in the serverless space you should know who @jlb13 is and follow him. https://twitter.com/sea_serverless/status/1121593143680327680
RT @celtics: Hondo, you set the bar.
#ForeverGreen ☘️ https://twitter.com/celtics/status/1121590970720473089/video/1
RT @ianmiell: @monkchips I finally got some of the ideas down: https://zwischenzugs.com/2019/04/12/apples-hq-ruskin-gothic-architecture-and-agile/ strangely it morphed into a tirade against Apple’s H…
Replying to @patrickdebois, @lindydonna, @JoeEmison, @jamieeduncan, @kelseyhightower and @ben11kehoe
What @patrickdebois said :)
RT @jlb13: Thanks for having me at the Serverless Seattle meetup @mweagle, @create33pnw, and @IOpipes! Great folks and super great talk fro…
Creative Types by Adobe Create https://mycreativetype.com/
“I want my Lambda functions to be small units of code that do one thing, and do it well.”
(via @Pocket) https://medium.com/@obie/aws-lambdas-can-have-shared-state-7047bacc79d1
“Regardless of the system, always remember that the purpose of measurement is to improve decision-making through a better understanding of reality.” (via @Pocket) https://danielmiessler.com/blog/the-difference-between-goals-strategies-metrics-okrs-kpis-and-kris/
“Organizational structure should be such that product teams are formed that have all of the necessary skills to deliver business functionality with minimum dependencies on other teams and maximum accountability for the product they are delivering.” https://medium.com/@chris.rimondi/devops-embedding-as-aiding-and-abetting-db112d1977a
I still can’t believe that I’ve lost a tactile row of keys in exchange for a TouchBar that freezes.
Replying to @edyesed
Thx :) I use an external one at the desk, but moving around for meetings is another story.
2020: Linux on the Desktop
“While the 1.0 version of serverless was all about stateless functions, the 2.0 version will focus largely on state — allowing us to built general-purpose distributed applications while enjoying the UX of serverless. “ https://thenewstack.io/serverless-needs-a-bolder-stateful-vision/
Replying to @moonpolysoft
Also ideas for versioning/reproducibility ?
Replying to @JoeEmison
It is. I still have the 2015 MBP and every encounter reminds me of what I’ve lost.
🙌 “You can get a full list of active regions, find out which services are available with them, and much more.” https://aws.amazon.com/blogs/aws/new-query-for-aws-regions-endpoints-and-more-using-aws-systems-manager-parameter-store/
RT @seclectech: @jeffsussna @drewfirment @nicolefv @jezhumble @RealGeneKim @barryoreilly I’m not sure how much of the developer <-> custome…
Replying to @rchrdbyd and @moonpolysoft
Yep. I think the ML shuffle/training/apply loop adds some new wrinkles though?
/cc @lynnlangit @whiskersedge ? https://twitter.com/moonpolysoft/status/1121882929582338048
@rchrdbyd: https://twitter.com/rchrdbyd/status/1122174515772108800?s=21
Replying to @PaulDJohnston
Fair, although I’d argue for the many world position. AWS wrote s2n in C99 even though there were pre-existing options to build on.
Replying to @tmclaughbos, @PaulDJohnston, @AWSALLIN, @ben11kehoe, @ajaynairthinks and @JoeEmison
I am all for serverless and don’t think that reducing everything to Developer Prime Mover is helpful. It takes a lot of two pizza teams to work together.
What is the organization of tomorrow? What will “engineering” mean in that context?
Replying to @ben11kehoe and @PaulDJohnston
TLS is a foundational capability and s2n was a commitment to owning that dependency with its ongoing support costs. I’m all for that and think other orgs should be able to make the same decisions (informed by newer options), but change is slow.
Replying to @ben11kehoe, @JoeEmison, @tmclaughbos, @PaulDJohnston, @AWSALLIN and @ajaynairthinks
Two Bagel Bite Service
Defining bounded contexts is hard and requires constant org coordination, ES/CQRS is relatively uncommon IME, and the world moves around (“Are we all GDPR compliant?”).
Replying to @JoeEmison, @rchrdbyd, @ben11kehoe, @tmclaughbos, @PaulDJohnston, @AWSALLIN and @ajaynairthinks
This 👆
Replying to @AWSALLIN, @PaulDJohnston, @ben11kehoe, @tmclaughbos, @ajaynairthinks and @JoeEmison
Word.
Still applies to #serverless https://twitter.com/mweagle/status/1101627748026478592
Replying to @ajaynairthinks, @AWSALLIN, @PaulDJohnston, @ben11kehoe, @tmclaughbos and @JoeEmison
Yep - also have to reign in the gap externalities to change what it means to be done.
I’ve been reading through the seemingly endless event pipeline/flow-based langs/specs/DSLs and yeah, that trail has yet to be cleared AFAICT.
Replying to @ben11kehoe
Maybe? The full on document approach has some X** prior art: https://camel.apache.org/walk-through-another-example.html
XSD to the rescue! 😉
Replying to @DreamingInCode
Yes, whenever possible :)
Replying to @ben11kehoe
It has...
Y*** is the new X**
😢
“That’s load-bearing whitespace”
Big 👍 https://twitter.com/seclectech/status/1122191656848117761
Replying to @edyesed
I am anxiously following this thread to decide whether to see it in the theater :)
Have fun and look forward to your review.
😎
https://www.packtpub.com/big-data-and-business-intelligence/go-machine-learning-projects
RT @DreamingInCode: @mweagle #CRDTLife
Replying to @rchrdbyd
Other side of the Cascades This week
Still haven’t seen Avengers
Replying to @skpodila
Thx. The valley down below is full of apple trees in bloom.
Thanos can wait 😉
“In this post, I explain how to deploy Airflow on Serverless environment.”
https://medium.com/@fartashh/serverless-data-engineering-platform-on-cloud-59741b5627a5
This is a very good job posting.
“We aspire to pursue the ways that help us learn; not chase after numbers. Building a learning organization is a real way that we are able to proactively and continually improve.”
https://jobs.netflix.com/jobs/869465
On trying to stop KD: “We tried everything.”
Replying to @samkroon and @acloudguru
Congratulations 🎉🎈
Replying to @skpodila
Ask open-ended questions and then wait.
RT @skpodila: What would be the one tip/advice you’d give a first time mentor?
About those “quick questions”...
“Research at UC Irvine found that after an interruption, it can take up to 23 minutes to regain focus on your original task.” (via @Pocket) https://getlighthouse.com/blog/break-vicious-cycle-reactive-management/
This entire post is 💯 on point. Huge 👍.
“[P]rioritize resilience over punishment.”
This is How Effective Leaders Move Beyond Blame (via @Pocket) #longreads https://firstround.com/review/this-is-how-effective-leaders-move-beyond-blame/
The New View of Safety is here, it’s just not evenly distributed.
Good episode.
Configuration specification remains challenging. /cc @ben11kehoe https://overcast.fm/+E_eO1Q90o/38:40
RT @lara_hogan: 2. Burn down distractions. Your attention is finite. It’s a scarce resource! Identify your values, and harness your attenti…
Replying to @hplociniczak
It’s soo dark.
Literally, like turn up the TV brightness dark.
Unexpected lunch connection: Menehune and Ethernet https://en.wikipedia.org/wiki/Menehune
Replying to @mweagle
“In the experimental 1970s Aloha network developed at the University of Hawaii, the packet controllers were called Menehune...The modern Ethernet was based on the carrier sense multiple access with collision detection (CSMA/CD) methodology pioneered by ALOHAnet.”
“This means that Airflow Operators inherently combine orchestration bugs with execution bugs.”
https://medium.com/bluecore-engineering/were-all-using-airflow-wrong-and-how-to-fix-it-a56f14cb0753
RT @littleidea: shocking plot twist, change requires actually changing https://www.plutora.com/blog/agile-devops-failing-fortune-500-companies-wake-call-us
Replying to @skpodila
Absolutely - great idea for a post and looking forward to reading.
Replying to @sallamar, @adrianco and @skpodila
Yep.
RT @sallamar: @adrianco @skpodila “Listen: You will learn as much if not more than your mentee in the process.”
Always, always
Not sure I’m a fan of analytics-ball. Watching a 6’10” player 3 feet from the rim throw a one handed pass for an off balance three seems wrong. #GSWvsHOU