“Everyone hates YAML. Everyone writes a lot of YAML.”
Graham King » A developer goes to a DevOps conference https://www.darkcoding.net/software/a-developer-goes-to-a-devops-conference/
“A cell is a collection of components, grouped from design and implementation into deployment. A cell is independently deployable, manageable, and observable.”
https://github.com/wso2/reference-architecture/blob/master/reference-architecture-cell-based.md
“In my time as a manger, I’ve encountered quite a few people who were badly onboarded. As a rule it takes as long a time or longer to fix it as it took to poorly onboard them.”
https://qz.com/work/1712534/how-to-create-a-good-onboarding-experience-for-new-hires/
RT @robotterror: Why use a Cloud provider when we can run k8s ourselves and have full control?
A hour later:
“To get our work life balance back and help the business expand, we took a month to create an automatic remediation system. In this post, we hope to share what we built and what we learned.”
https://eng.lyft.com/operating-apache-kafka-clusters-24-7-without-a-global-ops-team-417813a5ce70
“I know I can get out of this, and if you’re also burnt out, I bet you can beat it too.”
Strongly agree && sending 💪.
The Messy Realities of Burnout | Vallery Lancey https://timewitch.net/post/the-realities-of-burnout/
Replying to @kelseyhightower
I can see the appeal, but I hope not.
Replying to @chrismunns and @hichaelmart
I don’t feel like my call is that important after 10m on hold, TBH.
When planning meets reality
Replying to @vllry
Excellent recovery though.
RT @crayzeigh: Human error is never the cause of an incident. It’s an excuse to avoid learning. https://twitter.com/mattstratton/status/1179422688382767105
X: I went to the cloud and didn’t see a change.
Me: https://overcast.fm/+RWDUdwjvY
RT @kstewart: An engineering manager with 60 direct reports is not doing engineering management. https://twitter.com/mattetti/status/1179424874319626241
Is it presumptuous to self-RT because I think this convo with @nicolefv and @QuinnyPig is 💯 on-point?
How many RTs do I have left? https://twitter.com/mweagle/status/1179563249051693056
RT @vllry: “I got myself a gym membership, but if I didn’t do the work, I’m not going to get any better.” https://twitter.com/mweagle/status/1179563249051693056
“Think about incorporating the capabilities the world now offers and removing custom components and infrastructure that are no longer unique to your business.” (via @Pocket) https://blog.atomist.com/modern-software-world/
“Bigslice provides a coherent set of operators that helps the user efficiently compute over large data sets using ordinary Go code.” (via @Pocket) https://medium.com/grail-eng/bigslice-a-cluster-computing-system-for-go-7e03acd2419b
TIL: milestones seem too far apart? Try inchpebbles.
Mango: not a fan
Replying to @jbminn
Bingo bango
Replying to @_abhayshah
Mango lassi is an exception, but I can’t eat dairy 😞
Lesson: Crayons made Google successful. We must also use crayons.
Narrator: That is not the lesson.
“This Is Going to Be Huge”: Google Founders Collection Comes to Computer History Museum https://hackernoon.com/this-is-going-to-be-huge-google-founders-collection-comes-to-chm-27356256731f
😎
Railroad Diagram Generator(via @Pocket) https://pocket.co/xd6VqD
“One simple answer: Anywhere you use a websocket today, you can now consider replacing it with a serverless backend.”
Serverless Mullet Architectures(via @Pocket) #longreads https://pocket.co/xd6V22
“There are six core needs researchers find are most important for humans at work.“
(via @Pocket) https://www.palomamedina.com/biceps
RT @lizthegrey: Andrey Falko of Lyft begins the closing keynotes at #SREcon Europe by talking about applying the theory of fault tree analy…
Obstacles described on Twitter are larger than they read.
Provocative essay.
“I started by noting that solitude and leadership would seem to be contradictory things. But it seems to me that solitude is the very essence of leadership.”(via @Pocket) #longreads https://pocket.co/xd6AzD
“Having a culture where people are not optimizing to avoid mentioning something true but irrelevant means we make better technical decisions overall because we get the benefit of every teammate’s complete perspective.”(via @Pocket) #longreads https://pocket.co/xd6A56
“Some unique characteristics of the npm ecosystem vs other package ecosystems are the high number of transitive dependencies, and heavy reliance on micropackages consisting of only a few lines of code...So what could possibly go wrong?”
https://blog.acolyer.org/2019/09/30/small-world-with-high-risks/
Replying to @mweagle
A related “What could go wrong?” with this approach:
https://research.swtch.com/deps#what_could_go_wrong
Replying to @kstewart
Thanks - you’ve set a high bar that I’m still looking up at. 👊
Replying to @brianleroux
Yep. Almost as if when the language change, but the undesirable outcomes remain, and the shop never seems to evolve either way, then perhaps it’s not the technology that’s the limiting factor.
Mission accomplished:
“i think we need to give you a prize for having the best emoji and gif responses on slack”
RT @kstewart: Just got notified that the second of two writing projects (one article, one essay) I worked on this year will be going to pri…
Replying to @kstewart
Congratulations & looking forward to reading.
Replying to @IanColdwater
Going on 1.5 hours waiting to have phone fixed/replaced. #compileFTW
“Ah to the Mi” for the Cypress Hill Cloud fans https://overcast.fm/+SZZg0H2bc
I may need NBA League Pass.
Is #znation a thing yet? https://twitter.com/BleacherReport/status/1181355581258420224
“We have described a new approach that makes it easier to develop and deploy models, offers better model evaluation, and improves ability to respond.”
Machine Learning Logistics | MapR https://mapr.com/ebook/machine-learning-logistics/
Disappointed I can’t make #Serverlessconf this year 😞
Another great event with excellent people. 👋
Replying to @robotterror
Srsly. Same.
Replying to @mikebroberts
Miss you as well. Looks like fun!
Mood
https://www.amazon.com/Seat-Table-Leadership-Age-Agility/dp/1942788118
Disagree 😬 https://twitter.com/ryan_sb/status/1181628482880716805
Replying to @ben11kehoe
<cloud> <infra>Can't we all get along?</infra> </cloud>
Replying to @ben11kehoe, @_cat_turner and @rchrdbyd
Or is he? 😉
WDYT of https://github.com/cuelang/cue/blob/master/doc/tutorial/basics/Readme.md ?
Replying to @tmclaughbos and @ben11kehoe
I know when I’m outnumbered: Ben has the robots on his side
RT @rchrdbyd: Who wants to be on @ben11kehoe’s team in the tag team match against @mweagle and me in the Hell-in-a-Cell (architecture)? htt…
Replying to @rchrdbyd and @ben11kehoe
Replying to @StegerPatrick, @tmclaughbos and @ben11kehoe
We can do it together with the gophers!
“[W]e just witnessed how a container has been able to affect another container in a non-obvious way, even if they weren’t really competing over any physical resource.”(via @Pocket) #longreads https://pocket.co/xd9WTQ
“Model explainability is a priority in today’s data science community.”(via @Pocket) https://pocket.co/xdfx4m
“Most organizations end up using multi cloud. Only a handful told us they strategically embraced multi cloud.”(via @Pocket) https://pocket.co/xdfxs_
Dear @SlackHQ , is there a way to revoke all legacy tokens for a workspace?
Glossing over fundamental usability issues with cute language is immensely aggravating.
Replying to @SlackHQ
Thanks!
Replying to @rchrdbyd
Congratulations
wat
500,000 in California Are Without Electricity in Planned Shutdown https://www.nytimes.com/2019/10/09/us/pge-shut-off-power-outage.html
Replying to @PreetamJinka
It’s hard to believe. Hope it’s not bad for you.
Replying to @skpodila
RT @mfeathers: Config files are just global mutable variables put in a convenient place.
That doesn’t make them less problematic than any…
Replying to @_cat_turner, @ben11kehoe and @rchrdbyd
Yeah, soap is a bit much. 😀
Replying to @robotterror
Replying to @whiskersedge
Rolling blackouts due to “high demand” seemed like an odd explanation even at the time.
Replying to @rchrdbyd and @ben11kehoe
Is CDK available for go yet @rchrdbyd ? #day1
“Barbara Fusinska from Google demoed the Kubeflow project—designed to automate the deployment of TensorFlow-based models on Kubernetes.”(via @Pocket) https://pocket.co/xdfabi
“I got the fantastic opportunity to moderate a Q + A Session with Scott Guthrie, the Executive Vice President of the Cloud and AI organization at Microsoft.”(via @Pocket) https://peopleofcolorintech.com/articles/cheers-to-year-one-at-microsoft/
TFW you go into the review meeting and the team has been doing insanely well.
Wassup @joshroppo ? https://twitter.com/codesapien/status/1182460600351219713
X: ‘go’ should support macros Me: PTAL @ https://github.com/P-p-H-d/mlib and LMK what you think.
“Once we build humility into our processes, we can then build learning into our process.”
Becoming Outcome Focused: Q&A with Jeff Patton(via @Pocket) https://www.infoq.com/news/2019/10/outcome-focused-patton/
Replying to @SeanTAllen and @bketelsen
Replying to @DavidWells
Evergreen
Replying to @brianleroux, @benbridts and @ben11kehoe
Yep. I was never a fan of this aspect of Lambda.
Field of Greens (It was only about 10’x3’)
RT @spartago2: ICYMI... https://twitter.com/spartago2/status/1183042201074294785
Anyone using https://gocloud.dev/ rather than cloud-specific SDKs? Thoughts?
Replying to @hichaelmart
Park your server in Harvard yard.
“[P]eople are building their entire career around Kubernetes. In a few years, no one is going to care about it at all. It’s going to have simplified and slipped below the surface of awareness.”
https://www.techrepublic.com/article/aws-billing-is-broken-and-kubernetes-wont-last-says-irreverent-economist-corey-quinn/?utm_source=DevOps%27ish&utm_campaign=f4186005f7-DEVOPSISH_149&utm_medium=email&utm_term=0_eab566bc9f-f4186005f7-46452783
wat
Replying to @tobyhede
Welcome to Quantum and Ledger.
Your entry is important to us, please hold.
RT @sapessi: You can read Raghav’s story here https://link.medium.com/Fb3CIThkm0 and help by donating on this GoFundMe https://www.gofundme.com/f/supportRaghavsresearch
Retwee…
RT @sapessi: The energy, dedication, and positivity of @sanathkr_ and his wife are a true inspiration. https://twitter.com/sanathkr_/status/1183884912291532800
Replying to @sanathkr_ and @Microsoft
Sending support & best wishes. 🙏👊
Tick-Tock
Cloud Native Configuration Management - Speaker Deck https://speakerdeck.com/ahpook/cloud-native-configuration-management
“While it is tempting to make fun of this approach in serverless conferences and meetups, how about we ask ourselves a simple question — what properties can we borrow from this approach?”(via @Pocket) #longreads https://pocket.co/xd1sjn
“Dav Tagare from Lyft described their streaming platforms (160 billion writes / day over 11 clusters) — wow!” Kafka Summit 2019 San Francisco: a review(via @Pocket) https://pocket.co/xd1sJX
“The lesson from nature and the internet is that the sub-teams should look like a single, small software organisations. How small? Ideally one to five individuals.” (via @Pocket) #longreads https://pocket.co/sd1sqy
“One common objection is to raise the specter of lock-in.”(via @Pocket) #longreads https://pocket.co/xd1s_q
“What if you want to trace what happens inside a system call or library call? What if you want to do more than just logging calls, e.g. you want to compile statistics on certain behavior?”
Full-system dynamic tracing on Linux using eBPF and bpftrace https://www.joyfulbikeshedding.com/blog/2019-01-31-full-system-dynamic-tracing-on-linux-using-ebpf-and-bpftrace.html
Replying to @mweagle
wat wat?
“I got a bit distracted by the question of whether one could apply SRE procedures to something that does not involve any actual software engineering.” (via @Pocket) #longreads https://pocket.co/xd1q1M
Replying to @robbyrussell
I see your coffee and raise you:
Blockchain for 2 Chainz
“Slack is not air traffic control that coordinates everything. It’s 911 for when everything falls apart.” (via @Pocket) #longreads https://pocket.co/xd1qZu
“Expressing available SLOs in terms of ‘nines’ also causes some issues: it hides the difference between many short outages and a few long ones, which is something many customers care about.” (via @Pocket) #longreads https://pocket.co/xd1qyU
Me: lunch is solved! Driver: we only pickup food here, we don’t serve. Me: 😢
Thinking of you @ben11kehoe https://twitter.com/mweagle/status/1183962966221176832
Replying to @ben11kehoe
I am here for this.
“There reason for this is simple — most control planes in use today are… us.”
https://blog.envoyproxy.io/service-mesh-data-plane-vs-control-plane-2774e720f7fc
Configuration: The shape shifter of gifts
RT @benbridts: @ben11kehoe @mweagle I hadn’t. Link for people in my shoes: http://mikehadlow.blogspot.com/2012/05/configuration-complexity-clock.html
So this happened.
Thanks @beccaodelay and @awscloud #serverless
Great post @copyconstruct 👏
“Users are interacting with the production environment at all times, so in a manner of speaking, production is already constantly being exercised.”
https://medium.com/@copyconstruct/testing-in-production-the-hard-parts-3f06cefaf592
“I wonder if it would actually be better for software teams to build not the thing they want, but rather the thing that makes the thing they want.”
On a hierarchy of software engineering discourse https://uvwx.github.io/hierarchy.html
Replying to @kstewart
I’m reading these and channeling them through Jebidiah Atkinson...
https://www.nbc.com/saturday-night-live/video/weekend-update-jebidiah-atkinson/3506030
“In short, the core interface developers have used to compose software for the past 50 years—functions that exchange data through memory—misuses the most precious resources on modern hardware.”
https://arxiv.org/pdf/1709.06416.pdf
Personalization algo needs more data.
“We want the user to treat data errors with the same rigor and care that they deal with bugs in code. "
TFX: A TensorFlow-Based Production-Scale Machine Learning Platform http://delivery.acm.org/10.1145/3100000/3098021/p1387-baylor.pdf?ip=4.71.153.57&id=3098021&acc=OA&key=4D4702B0C3E38B35%2E4D4702B0C3E38B35%2E4D4702B0C3E38B35%2E5945DC2EABF3343C&__acm__=1571254152_07fe9a80d012e5199ca78721f948fa07
Replying to @lindydonna
A manager that doesn’t look for signs of burnout isn’t managing.
“Why this zone is so hard: It’s stateful and serverless!”
Serverless State: ServerlessConf Presentation 2019 - Google Slides https://docs.google.com/presentation/d/1g06UmzJXAh_l7-uohwJyQXG0nS5J93uOpBEKYXANB7o/edit#slide=id.g647e4cc2ef_0_449
Replying to @ben11kehoe
The nice thing about Weld is that it uses existing commonly used libraries.
“Machine learning will play an important role in optimizing execution” https://docs.google.com/presentation/d/1k2rsaMGdsvWrV1HhzDOrVPvq6kDgQj6_0MAZ7NoFl58/mobilepresent?slide=id.g40ccf77c14217d7c_533
Replying to @endsofthreads
You bet - adding that one to the queue. Any others you’ve read recently you like?
Replying to @endsofthreads and @frankmcsherry
Thanks!
Replying to @ben11kehoe
Neptune 👀
There are a lot of good points in this conversation and I would also add that everyone across the organization is typically experimenting and learning. Even if that experimentation is “hidden” behind an API.
https://twimlai.com/twiml-talk-308-live-from-twimlcon-culture-organization-for-effective-ml-at-scale-panel/
“CloudWatch Anomaly Detection has its roots in over 12,000 internal models.”
https://aws.amazon.com/blogs/aws/new-amazon-cloudwatch-anomaly-detection/
“Dapr exposes its APIs as a sidecar architecture, either as a container or as a process, not requiring the application code to include any Dapr runtime code.”
https://github.com/dapr/docs/blob/master/overview.md
🤔 “When it comes to application development and deployment, we think it is important to distinguish between the parts that developers are responsible for, and the parts that operations is responsible for.”
The Open Application Model specification https://github.com/oam-dev/spec/
Replying to @mweagle
1. The developer creates a web application; 2. The application operator deploys instances of that application, and configures it with operational traits, such as autoscaling;
...
Replying to @mweagle
3. The infrastructure operator decides which underlying technology is used to handle the deployment and operations.
https://github.com/oam-dev/spec/blob/master/introduction.md
Replying to @evanderkoogh
Yeah - I don’t think we’re the target user for this 😉
“At its peak, the framework processed 470 million events per second.” (via @Pocket) #longreads https://pocket.co/xda6i3
RT @vllry: I’m suspicious that pure dev/ops separation is snake oil. Abstractions leak - at some point you need to know what you want your…
Replying to @fintanr and @Gartner_inc
“Moving from using ML and AI for experimental proof-of-concept applications to production systems requires important upfront work and ongoing maintenance.”
+💯
Dear AMZ, It shouldn’t be this hard to logout of the iOS app.
Replying to @joshroppo
The Appendix is huge.
“Conferences like this help, but more and better documentation, more sharing of best practices, and tools that can truly streamline the job of delivering business value on top of Serverless remain a work in progress.”(via @Pocket) https://pocket.co/xdaskG
“What if we could make building tools as easy as writing Python scripts?”(via @Pocket) https://pocket.co/xdasyK
Replying to @edyesed
Sending links
https://www.ardanlabs.com/blog/2019/09/context-package-semantics-in-go.html
Replying to @edyesed
Web of deceit. One more: https://peter.bourgon.org/blog/2016/07/11/context.html
“The management path isn’t the only way to be a technical leader.”(via @Pocket) http://keavy.com/work/thriving-on-the-technical-leadership-path/
“Serverless functions are fundamentally event-driven. There are two basic ways to trigger a serverless function: directly with an invocation, or indirectly based on something that occurred in the world.”(via @Pocket) #longreads https://pocket.co/xdazP3
“Every layer of the technical stack from development to production has become more complicated, involving more moving parts. What’s unclear is how sustainable this trend is.”
Integrated Innovation and the Rise of Complexity – tecosystems https://redmonk.com/sogrady/2019/10/18/complexity-integrated-innovation/
RT @brianleroux: Eh @sogrady fyi http://Begin.com is an integrated solution for deploying to AWS in literal seconds that you can eje…
Replying to @edyesed
Anytime. Possibly related to https://www.sohamkamani.com/blog/golang/2018-06-17-golang-using-context-cancellation/ ?
RT @kstewart: Thanks, @jennyb2004! 👊🏿
Good documentation is very valuable.
https://github.com/awslabs/amazon-sagemaker-examples/blob/master/advanced_functionality/tensorflow_bring_your_own/tensorflow_bring_your_own.ipynb
Replying to @edyesed
That looks 👍 to me and a pattern I also use for paginated APIs.
Context in this case could be used to take a --timeout CLI arg that is used with https://golang.org/pkg/context/#WithTimeout .
Replying to @edyesed
In Lambda it includes cross cutting information (eg: Deadline()) and props: https://docs.aws.amazon.com/en_pv/lambda/latest/dg/go-programming-model-context.html
Sparta stuffs a logger, session info in there: https://github.com/mweagle/Sparta/blob/master/sparta_constants.go#L82
MFW the new thermostat works great and I realize the prior house painters bagged the unit rather than removing it before painting.
I now have a dumb paint ridge to deal with.
Replying to @vllry
That looks smarter than the “smart” thermostat I installed. I’m going to give it a week to make sure it works ok before dealing with the wall repair.
Let’s see how this goes...
Replying to @vllry
You know it.
Reading “feature” in the context of ML
Origin story of “This is fine dogwood” https://twitter.com/sofain/status/1185710469681680387
“This post will serve as a simple end-to-end example of how to use your own tensorflow-model to do inference in your go-application.” (via @Pocket) https://pocket.co/xdeazt
‘I believe we’ll start to see more “architecture as code” tooling emerge that enables developers to describe their microservices in terms of high-level infrastructure patterns.’ (via @Pocket) #longreads https://pocket.co/xdeaje
RT @MissAmyTobey: Identifying misalignment is easy. Convincing people that it exists is significantly more difficult.
Gotta make a move to a cloud that’s right for me Town to keep me devn' Keep me deploy’n with some energy Well, I talk about it, talk about it Talk about it, talk about it Talk about, talk about Talk about movin' ... ... Won’t you take me to Multicloud?
https://open.spotify.com/track/4vAeAdQuqHE8NYi1xrZzX8?si=Y5oU3aYFQku1mxGBqGyU9g
Replying to @chrismunns
This game is not as interesting as I had wished. #ZionWilliamson
Replying to @ryan_sb and @film_girl
WeDidntWork ?
I would like to read this.
“How was I supposed to ever learn what that team members was thinking and feeling about the company if I never talked with them?”(via @Pocket) #longreads https://pocket.co/xderuY
“This means ingesting a lot of data, sometimes billions of records per day, which we do in realtime using Kinesis and Lambda.”(via @Pocket) https://read.iopipe.com/lessons-from-building-a-serverless-data-pipeline-with-aws-kinesis-and-lambda-4d8cf0ebcbc9
“Delta is an eventual consistent, event driven, data synchronization and enrichment platform.”(via @Pocket) #longreads https://medium.com/netflix-techblog/delta-a-data-synchronization-and-enrichment-platform-e82c36a79aee
“In this article, I am sharing one of our ML use cases and things considered in deploying it to AWS lambda.”(via @Pocket) https://pocket.co/xdeP65
“Serverless computing is one technology that helps Amazon innovate faster than before. It frees up time for internal teams by eliminating the need to provision, scale, and patch infrastructure.”(via @Pocket) #longreads https://aws.amazon.com/blogs/opensource/real-world-serverless-application/
RT @KR1573N: Set the standard. https://twitter.com/ManningBooks/status/1186678708704350208
Replying to @brianleroux
It’s exhausting.
Replying to @jessfraz, @brianleroux, @kstewart, @kelseyhightower and @ben11kehoe
I don’t know of an old school/sustainable Enterprise that’s 💯 percent anything or if that’s even feasible.
Replying to @kstewart, @brianleroux, @kelseyhightower, @jessfraz and @ben11kehoe
PB&J
Also: needs bread that only the org can bake.
Replying to @kstewart, @kelseyhightower, @jessfraz, @brianleroux and @ben11kehoe
ducking autocorrect 😡
RT @sallamar: @jessfraz @kelseyhightower @brianleroux @kstewart @mweagle @ben11kehoe I believe that all survivors must pay the migration pe…
RT @FarrahC32: @kneekey23 @kylie_robison @clare_liguori @abbyfuller @ewindisch @tiffanyfayj ❤️ thank you.
I am happy to add a few @lcoone…
Watching Montrezl: highly recommended https://twitter.com/andscape/status/1187014563704688640
RT @lizthegrey: @patrickdebois @stack72 @Monitorama @o11ycon also omg yeah I’m so sick of people pushing tools rather than culture :/
is w…
“Full stack” taking on a whole new meaning. https://twitter.com/hardmaru/status/1186938912255561728
This is a good paper.
https://www.microsoft.com/en-us/research/publication/software-engineering-for-machine-learning-a-case-study/
Replying to @rchrdbyd, @IanMmmm, @danilop and @chrismunns
Hybrid Taco is also possible
https://en.wikipedia.org/wiki/Choco_Taco
Load-bearing whitespace https://twitter.com/tottinge/status/1187077883610697728
Replying to @kstewart, @GitPrime, @thebent and @br00kperry
NOICE!
wait, i can’t buy this?
Replying to @copyconstruct, @kstewart, @GitPrime and @thebent
Can I join your team?
Replying to @brookprry, @thebent, @kstewart and @GitPrime
Most appreciated! DM incoming...
Replying to @brianleroux
Over here in ML 👋
Replying to @brianleroux
Slide 25 in @timallenwagner s
https://docs.google.com/presentation/d/1g06UmzJXAh_l7-uohwJyQXG0nS5J93uOpBEKYXANB7o/mobilepresent?usp=embed_facebook
Mood
RT @caitie: One of the biggest fallacies in tech is that you can solve culture problems by writing the perfect piece of code.
Replying to @Jowanza
Noice!
op·er·a·tion: an active process; a discharge of a function.
The only time ops are “eliminated” is when the active process is made inactive.
Me: “request scoped, structured log data” seems like a good description.
Java:
Replying to @patrickdebois and @chrismunns
Replying to @ben11kehoe and @Serverlessconf
RT @ben11kehoe: For everyone who didn’t make it to @Serverlessconf, video for my talk “YAML is better than your favorite language” is now u…
Replying to @ben11kehoe, @QuinnyPig and @Serverlessconf
YML records are the future
“As you can see, you can really focus on implementing the business logic.”
How to Build a UDF and/or UDAF in KSQL 5.0 | Confluent https://www.confluent.io/blog/build-udf-udaf-ksql-5-0
“KSQL enables data scientists to take a look at Kafka event streams and implement continuous stream processing from their well-known and loved Python environments like Jupyter...”
Machine Learning with Python, Jupyter, KSQL and TensorFlow | Confluent https://www.confluent.io/blog/machine-learning-with-python-jupyter-ksql-tensorflow
Teeing this up for you @QuinnyPig
https://www.forbes.com/sites/greatspeculations/2019/10/25/why-an-amazon-oracle-merger-is-a-very-real-possibility/#6b9983f45b3f
“After designing and learning a ML model, the hardest part is actually running and maintaining it in production.”
Pure serverless machine learning inference with AWS Lambda and Layers https://medium.com/merapar/pure-serverless-machine-learning-inference-with-aws-lambda-and-layers-979702d9ae49
Replying to @robotterror and @QuinnyPig
Yep
Huckster News: The pinstripe site
How much time do I have?
Replying to @StegerPatrick and @QuinnyPig
ducking autocorrect strikes again.
Replying to @kstewart and @QuinnyPig
RT @lindydonna: We have an update on @KnativeProject project governance. This was a joint effort between Google, IBM, RedHat, and Pivotal.…
Replying to @ben11kehoe and @Serverlessconf
I agree with a lot of what you’re saying, but I think we might have to Agree to Disagree on this one 😀
Replying to @ben11kehoe and @Serverlessconf
WDTY about the ability to express graph invariants that must hold for all infra substates across time? Pre/post conditions.
Not sure if AWS Config can do this as part of a mutation.
😎
https://aws.amazon.com/blogs/containers/amazon-ecr-native-container-image-scanning/
The kind of technology I can get behind.
https://www.getambassador.io/
Replying to @mweagle
Twitterers who like that tweet may also like
https://mcfunley.com/choose-boring-technology
Saw this in SEA.
I am skeptical it’ll be Open Soon.
Replying to @listonb
Capital Hill
“Managers have direct influence over the tenure of employees but also have influence over how fast teams can establish norms to work better together.” (via @Pocket) #longreads https://www.fellow.app/blog/2019/10x-managers-supermanagers/
“In reaching v1.0 and moving to Incubation, the spec defines the common attributes of an event that facilitate interoperability, as well as how those attributes are transported from producer to consumer via some popular protocols.” https://www.cncf.io/announcement/2019/10/28/serverless-specification-cloudevents-reaches-version-1-0/
“What we need is a quick and easy way to go from our big data model to a micro-service that provides just one prediction at a time, on demand.”(via @Pocket) #longreads https://towardsdatascience.com/from-big-data-to-micro-services-how-to-serve-spark-trained-models-through-aws-lambdas-ebe129f4849c
There are a lot of good insights in this article, including: “No one will use a product that they can’t trust.”
How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh https://martinfowler.com/articles/data-monolith-to-mesh.html
Replying to @joshroppo
It seems reasonable, but IMO the real power is leaning into a single ecosystem. A common event format will limit my ability to do that/push complexity into the ‘data’ handler.
Replying to @joshroppo
Reminds me of the standard, yet not very widely adopted REST types (JSON-LD, HAL).
Replying to @joshroppo
“But MLeap hides the differences of the underlying model training implementations from clients behind a unified scoring API.”
https://medium.com/expedia-group-tech/real-time-serving-machine-learning-models-with-mleap-151b39dfc3d7
Just realized the Catalina OS update is installing.
Replying to @mikemaccana
Tentative status
Replying to @_abhayshah
Possibly
“Programs must be written for people to read, and only incidentally for machines to execute.”(via @Pocket) #longreads https://pocket.co/xdUCKK
RT @fabius_sarah: “Complexity turns reliable software into unreliable software. Complexity is what leads to unmaintainable software. Comple…
GOTO: Visualizing Cloud Systems by @lynnlangit https://slides.com/lynnlangit/goto-viz-cloud-systems#/6
Evergreen tweet https://twitter.com/caitie/status/1187398108826619905
The Advantage: Why Organizational Health Trumps Everything Else in Business https://learning.oreilly.com/library/view/the-advantage-why/9780470941522/ffirs01.xhtml via @safari
Replying to @jaqx0r
Absolutely 🙇. Looking forward to the deck/recording!
RT @John_POPS_Spoon: It is with deep sadness we have to tweet this, but our husband & father John Witherspoon has passed away. He was a Leg…
Cleanup in aisle 4 - some metaphors were spilled.
“According to thermodynamics, perpetual motion is impossible. But who said the laws of physics have to apply to business?”
https://pages.awscloud.com/data-flywheel.html
“Containers...
Does not solve the issue of standardization.”
QConSP18-DeployingML-May18-NPentreath https://qconsp.com/sp2018/system/files/presentation-slides/qconsp18-deployingml-may18-npentreath.pdf
“We have created an architecture for embedding arbitrary CNTK computation graphs and OpenCV computations in Spark computation graphs.”
https://arxiv.org/pdf/1804.04031.pdf
Lambda is the tail wagging the dog
Also, reminder that Lambda natively supports ‘go’ as a runtime. 👍 https://overcast.fm/+GqKVv43oI
“TensorFlow Enterprise offers a white-glove service to help these cutting-edge customers tackle their biggest AI challenges. It includes engineer-to-engineer assistance from both Google Cloud and TensorFlow teams at Google.”
https://cloud.google.com/blog/products/ai-machine-learning/introducing-tensorflow-enterprise-supported-scalable-and-seamless-tensorflow-in-the-cloud