How to Share Terabytes of Live Data with Delta Sharing
Description changed:
In this technical session DataBricks' Frank Munz, will introduce Delta Sharing, a Linux Foundation open source solution for sharing massive amounts of live data in a cheap, secure, and scalable way.
Delta sharing uses pandas or Apache Spark for the real-time exchange of large data sets, enabling secure data sharing across products for the first time. It leverages modern cloud object stores, such as S3, ADLS, or GCS, to reliably transfer large data sets. An open-sourced reference sharing service is available to get started.
Within the Databricks ecosystem, Unity Catalog implements the open source Delta Sharing protocol, so you can share data across organization regardless of system boundaries, compute platform or cloud provider.
This is a technical session with difficulty level easy/medium (L300).
Speaker Bio
Dr. Frank Munz is a Staff Developer Advocate at Databricks. He is the published author of three computer science books. Frank built up technical evangelism for Amazon Web Services in Germany, Austria, and Switzerland. He is a certified AWS and GCP Professional Cloud Architect and ML/Data Engineer. Frank fullfilled his dream to speak at top-notch conferences on every continent (except antarctica, because it is too cold there). He presented at conferences such as Devoxx, Kubecon, re:Invent, Voxxed Days, and Java One. He holds a PhD in Computer Science from TU Munich.
When Frank is not working, he enjoys travelling in Southeast Asia, skiing in the Dolomites, tapas in Spain, and scuba diving in Australia.
At this panel discussion, looking at Pride in the technology and data industries, hosted by MBN Marketing Manager and co-author of The Future of Talent whitepaper, Seb Mackay we're looking at Pride in the technology and data industries, where progress needs to be made and how far we've come.
Seb is joined by Rich Wilson (Gartner) and Frida de Sigla (who works in Artificial Intelligence).
Join MBN's Bethany Rodgers-Rintoul as she hosts a panel discussion on diversity in STEM and why having a diverse workforce matters.
Bethany will be joined by Amber Lawther (BI and Analytics, NHS NSS), Duncan Hart (CEO, Deepminer) and Fash Fasoro (Data Governance, HomePointr, and Programme Director at The DataKirk) in talking about why diversity is fundamental to the growth and development of any organisation and how to create an inclusive environment that recognises, appreciates and embraces everyone.
We will discuss all types of diversity- gender diversity, sexual orientation and able-bodied-ness are just a few of the important aspects that need to be included in the conversation.
Diversity refers to difference and difference is what makes us all unique and should be a celebrated attribute.
Lakehouse : what it is and how can transform your company
Description changed:
Dr. Guillermo G Schiava D'Albano –
Team Lead Nordics SA - Solution Architect at Databricks -https://www.linkedin.com/in/g-schiava
Lakehouse : what it is and how can transform your company
Traditional EDW are good to store structure data, with a high cost per GB.
Traditional Data Lakes on the cloud are good to store unstructured data, not supporting classic ACID operations found on EDW.
At the same time Data lakes have lower cost per GB than a traditional EDW.
AI usually requires the combination of different sources structured and unstructured.
The traditional way to solve the shortcomings of these technologies is to combine them with difficult to main ETLs
Lakehouse is a new open architect that combines the best elements of EDW and Data Lakes. On top of open standards that allows costumes to never be vendor lock.
Darren Moffat @ MBN Solutions will be the chair for this event - https://www.linkedin.com/in/darren-moffat
What to do with your data in a serverless world - Angela Timofte @ TrustPilot
Description changed:
Angela Timofte (Presenter) - Data Platform Manager at Trustpilot | AWS Hero | Winner Developer of the Year - https://www.linkedin.com/in/angela-timofte-it
From SMBs to Enterprises, everyone is trying or wants to go serverless first, however many times we don’t hear about what we should do with the data, how to store it, where to store it, and what options is AWS offering us.
Throughout my presentation, I’d like to showcase how Trustpilot is thinking about data storage when creating new applications or migrating old ones together with examples of struggles and learnings from these experiences.
Darren Moffat @ MBN Solutions will be the chair for this event - https://www.linkedin.com/in/darren-moffat
We are delighted to support this Talent4Point0 event - https://talent4point0.com/
In recent years, there has been an increased uptake and popularity of technical training and development courses. Innovative organisations in Scotland have been at the forefront of this development, helping to aid and develop the next generation of data savvy professionals.
✔ What is this journey like for women in STEM?
✔ Have they embraced this trend- what obstacles have they faced?
✔ And, most importantly - what opportunities wait for them at the end?
Together, we will discuss some of the key issues around women career changers and those who have up-skilled.
✔ How we do make women aware of the sideways move into tech?
✔ How are we able to embrace and encourage women from non-technical/ coding backgrounds to upskill and meet the demand of the skills shortage?
✔ What are the main challenges of returning/ starting a career in tech?
During this event, we will follow the story of 3 influential women in STEM, who each have their own unique story – followed up with a lively questions and answer discussion.
Agenda
Thursday 3rd December 2020, 1pm - 2.30pm
ZOOM Conference
13.00 – 13.10 Introduction to Talent4Point0 by Elizabeth Hollinger Director of Insight | Data | Applications Development @ Aggreko - https://www.linkedin.com/in/elizabeth-hollinger-31055234
13.10 – 13.20 - Overview of the event by Bethany Rodgers-Rintoul – Project Manager @ MBN Academy - https://www.linkedin.com/in/bethanybrodgers
13.20– 13.35 - Joanna Glenfield - Project Officer, Equate Scotland – Introducing Equate Scotland/ The landscape for women in STEM/services Equate Scotland offer -https://www.linkedin.com/in/joanna-glenfield-a636771b
13.35 – 13.50 - Eleanor Mitchell- AI consultant (sharing her story) - https://www.linkedin.com/in/eleanor-mitchell-571179
Integrating Continuous Delivery to streamline banking deliveries
Description changed:
Integrating Continuous Delivery to streamline banking deliveries
Colin Armstrong from Tesco Bank, one of the UKs leading retail banks, is going to deliver a presentation on “Integrating Continuous Delivery to streamline banking deliveries"
Colin is a very successful Principal Engineer at Tesco Bank and has worked in the banking sector for 20 years. He wants to share how the bank are doing things and it is a great opportunity for the members to "Find out how Tesco Bank are bringing the disciplines of test, software and infrastructure engineering together to form a single unified approach to CD in the public and private clouds".
Colin Armstrong, Tesco Bank - https://www.linkedin.com/in/cbarmstrong
Darren Moffat - Principal Contract Consultant @ MBN will be hosting the event - https://www.linkedin.com/in/darren-moffat
Gordy Wills - Head of Software Engineering • Intelligent Growth Solutions - https://www.linkedin.com/in/gordywills/
www.intelligentgrowthsolutions.com
When is a farm not a farm, when it is a factory that produces food from seed to packet. Our product is a totally controlled environment agriculture machine that is built in a warehouse not on traditional farming land. The machine is supper clever, but only works when it is given the right commands by its OS. Customer facilities have up to 40 of these machines so they also need production planning, task management and maintenance planning. The volume of data produced by each machine is huge; biology is messy and is not an exact engineering process, but the information in the data can show patterns which we can feed in to ML models to enhance the value of our sensors - or even in to AI models to run experimentation on how changes in environmental factors can increase crop yield or improve flavours.
Sounds exciting; a little over 12 months ago I was asked to start building the OS, the production planning, and the data streams; and actually, it is terrifying. We are a long way away from realising it all, but we just launched version 0.18 to our experimental farm and are deploying to our first paying customer by the end of the year. I want to tell you where we are, what we have done, things we know were a mistake and things we still think might be right. Our tech stack is C#.Net microservices with an Angular frontend served up in a K8s cluster with SqlServer backing, all sat in Azure, communicating to the farm using OPCUA and protected by Azure AD.
Hope you can join us; hope we can learn things from each other.
***PLEASE SHARE WITH EVERY 10 - 16 YEAR OLD YOU KNOW*** Get your children, nieces, nephews, friends kids etc involved....
Merkle’s STEM ambassadors are delighted to be hosting a data science workshop for the wider data science community aimed at school pupils aged 10-16.
During our interactive session we will cover different roles within data, with a focus on the role of a data scientist/analyst.
We introduce the concept of data and its forms in a fun and engaging way by relating it back to real life examples such as how TikTok, Snapchat and Instagram use customer data.
One of the three examples we discuss is how companies such as Netflix use data to recommend films/programmes based on an individual’s likes.
Our data scientists are passionate about engaging the next generation and hope you can join us for this session.
Please feel free to forward this invitation on to family/friends/clubs that you think may find this interesting.
If you can’t make this session, but this is something that interests you, please feel free to get in touch with us: stemedn@merkleinc.com
NB. Please note that to accommodate all ages and keep engagement, this session will be high level – we will not be going into technical details of algorithms.
***PLEASE SHARE WITH EVERY 10 - 16 YEAR OLD YOU KNOW*** Get your children, nieces, nephews, friends kids etc involved....
Merkle’s STEM ambassadors are delighted to be hosting a data science workshop for the wider data science community aimed at school pupils aged 10-16.
During our interactive session we will cover different roles within data, with a focus on the role of a data scientist/analyst.
We introduce the concept of data and its forms in a fun and engaging way by relating it back to real life examples such as how TikTok, Snapchat and Instagram use customer data.
One of the three examples we discuss is how companies such as Netflix use data to recommend films/programmes based on an individual’s likes.
Our data scientists are passionate about engaging the next generation and hope you can join us for this session.
Please feel free to forward this invitation on to family/friends/clubs that you think may find this interesting.
If you can’t make this session, but this is something that interests you, please feel free to get in touch with us: stemedn@merklinc.com
NB. Please note that to accommodate all ages and keep engagement, this session will be high level – we will not be going into technical details of algorithms.
***PLEASE SHARE WITH EVERY 10 - 16 YEAR OLD YOU KNOW*** Get your children, nieces, nephews, friends kids etc involved....
Merkle’s STEM ambassadors are delighted to be hosting a data science workshop for the wider data science community aimed at school pupils aged 10-16.
During our interactive session we will cover different roles within data, with a focus on the role of a data scientist/analyst.
We introduce the concept of data and its forms in a fun and engaging way by relating it back to real life examples such as how TikTok, Snapchat and Instagram use customer data.
One of the three examples we discuss is how companies such as Netflix use data to recommend films/programmes based on an individual’s likes.
Our data scientists are passionate about engaging the next generation and hope you can join us for this session.
Please feel free to forward this invitation on to family/friends/clubs that you think may find this interesting.
If you can’t make this session, but this is something that interests you, please feel free to get in touch with us: stemedn@merklinc.com
NB. Please note that to accommodate all ages and keep engagement, this session will not be high level – we will not be going into technical details of algorithms.
Have you ever just wanted to get your application up and running without needing to get lost in K8s deployment YAML? Can you not just take my application and take care of the "wiring", scaling and serve it?
A solution to abstract some of the complexity of deploying workloads to K8s away is based around the Knative project which is the basis for Google's Cloud Run - what is it, how can it help and show me it working!
Rob Edwards - Hybrid Cloud and Application Modernisation Specialist @ Google
https://www.linkedin.com/in/robedwards
@clijockey
A massive fan of coffee who uses its magic to solve problems. Over the years he has worn a number of hats in the infrastructure, operations and cloud space, the last few years have been spent helping developers be more productive and help operations teams be more efficient.
Abstract: To many open source is just software that you find and download under an OSI license. Open source however has the ability the give organisations tremendous strategic advantage when positioned and used well. In this talk you will understand more about what open source really is and how business should think about this.
Speaker - Ricardo Sueiras - Cloud Evangelist at AWS
https://www.linkedin.com/in/ricardosueiras/
***DON'T REG ON THIS PAGE! All registrations via the link below***
https://webinar.meetupmadness.io/sessions/k8s_docker_7july#/?source=meetupdotcomN
Hi Everyone,
We are back with another Meetup via live streaming! Please register via the link below.
VERY IMPORTANT REMINDERS
1. Each session will have a 200 registration limit so please update your RSVPs early through the link below.
2. This is a combined state Meetup scheduled on 07 July (Tue)
3. **Viewing** - Best viewed from your desktop with Chrome or Firefox
*****REGISTER via this link*****
https://webinar.meetupmadness.io/sessions/k8s_docker_7july#/?source=meetupdotcomN
Talk 1 (6:00 pm - 6:45 pm)
-------------------------------------
TOPIC: 'Tekton the Sequel'
This time it's (im)personal: Inspired by a question that was posed at a recent meetup, we look at Tekton the Kubernetes-native CI/CD through the objective lens of the more traditional Jenkins Pipelines running on Kubernetes and attempt to answer the question whether the world really needs another CI/CD toolchain. We'll compare and contrast the approaches with a discussion and demo of how the two CI/CD products implement the typical pipeline phases of building a tomcat application (e.g. build, test, analyze, image-build, etc) in Kubernetes. And we'll find out what Tekton has to do with a cheesy "Reese's Peanut Butter Cups" commercial from the 1980s. No prior knowledge of Tekton is necessary & links to a demo repo will be provided for those that persevere to the end of the talk!
SPEAKER: Marc Hildenbrand - Developer Advocate, RedHat
A lifelong software engineer, he has over 20 years of experience in software development. During his varied career he has been involved in the development of various exciting projects from large scale video games (such as Lord of the Rings Online) to 7-Eleven’s Fuel App, and the middleware that supports Public Transport Victoria’s mobile app which is used by thousands of commuters per day.
Prior to joining Red Hat, Marc was the global CTO of the award-winning digital consulting firm Tigerspike and was instrumental in making them one of AWS's hottest "APN Advanced Consulting" partners. He has a broad perspective on the development lifecycle and on what works (and does not work) when it comes to software projects.
Talk 2 - TBC
-----------------
Big shout out to our awesome community partner, #ZOHO!!! Thank you!
***DON'T REG ON THIS PAGE! All registrations via the link below***
https://webinar.meetupmadness.io/sessions/k8s_docker_7july#/?source=meetupdotcomN
We thought this topic could be of interest to members of the group...
A Full-Stack Data Scientist - What is it and how to become one.
Presenter - Alexey Grigorev - Lead Data Scientist at OLX Group
https://www.linkedin.com/in/agrigorev
Alexey lives in Berlin with his wife and son. He’s a software engineer with a focus on machine learning. He works at OLX Group as a Lead Data Scientist. Alexey is a Kaggle master and he wrote a couple of books. One of them is “Mastering Java for Data Science” and now he’s working on another one — “Machine Learning Bookcamp”.
Chair - Robin Huggins, Director of Academy and Client Services at MBN Solutions | Data IQ 100 2019 & 2020 - https://www.linkedin.com/in/robinhuggins
As Director of Academy & Client Services at MBN Solutions, Rob has spent his career at the sharp end of Talent Acquisition practice for the Data & Technology sectors.
Working as Delivery Partner for The Data Lab's MSc. Placement Programme, he designed and deployed the highly successful Employability framework that has seen over 250 aspirant Data practitioners placed into Scottish organisations over the last 4 years.
Rob sits on The University of Glasgow's School of Maths & Stats Industrial Advisory Board, acts as a Talent Advisor to DMA Scotland, contributes to Scotland’s AI Strategy as a member of the Skills & Knowledge Group and is a regular host, presenter and guest on a variety of Data & Technology related media and events.
Rob has been recognised by Data IQ as one of their 100 most influential Data and Analytics practitioners in UK organisations two years running
Please register here - https://us02web.zoom.us/webinar/register/WN_qRaGyPhrTDK5yGhDBs3DoQ
'Digital Transformation w/ Kubernetes' by Adrian Deccico
Description changed:
***DON'T REG ON THIS PAGE! All registrations via the link below***
https://webinar.meetupmadness.io/sessions/k8s_docker_25june#/?source=meetupdotcomN
Hi Everyone,
We are back with another Meetup via live streaming! Please register via the link below.
VERY IMPORTANT REMINDERS
1. Each session will have a 200 registration limit so please update your RSVPs early through the link below.
2. This is a combined state Meetup scheduled on 25 June (Thur)
3. **Viewing** - Best viewed from your desktop with Chrome or Firefox
*****REGISTER via this link*****
https://webinar.meetupmadness.io/sessions/k8s_docker_25june#/?source=meetupdotcomN
Talk 1 (9:00 am - 9.45 am)
-------------------------------------
TOPIC: "Digital Transformation with Kubernetes"
Adrian's talk will describe IT's previous status & how they improved everything w/ Kubernetes & DevOps magic, wherein they achieved a dramatic increase in their Dev Productivity, Prod Stability & Platform Security.
SPEAKER(S): Adrián Deccico - Co-founder/Director, Darumatic
Adrián is a Solutions Architect with 20 years experience in Software Development, DevOps and IT Consulting. He worked across many top tier companies such as Atlassian, Electronic Arts, Verizon and Optiver across within three different continents.
In early 2017 he co-founded his own Kubernetes and Cloud Native focused consulting company, Darumatic, where he is helping his many customers to "build better software".
Talk 2 - (9.45 am - 10.30am)
--------------------------------------
TOPIC: TBA - Awesome goodness still being brewed ;-)
SPEAKER: Prateek Nayak
Thanks to our awesome sponsor, DARUMATIC & community partner, ZOHO!
***DON'T REG ON THIS PAGE! All registrations via the link below***
https://webinar.meetupmadness.io/sessions/k8s_docker_25june#/?source=meetupdotcomN
A Full-Stack Data Scientist - What is it and how to become one
Description changed:
We thought this topic could be of interest to members of the group...
A Full-Stack Data Scientist - What is it and how to become one.
Presenter - Alexey Grigorev - Lead Data Scientist at OLX Group
https://www.linkedin.com/in/agrigorev
Alexey lives in Berlin with his wife and son. He’s a software engineer with a focus on machine learning. He works at OLX Group as a Lead Data Scientist. Alexey is a Kaggle master and he wrote a couple of books. One of them is “Mastering Java for Data Science” and now he’s working on another one — “Machine Learning Bookcamp”.
Chair - Paul Forrest - Chairman @ MBN Solutions
https://www.linkedin.com/in/pdf66
Paul has some twenty-five years experience of helping businesses to solve complex business problems, deliver their transformation goals and to achieve tangible strategic outcomes.
Hands on and deep thinking, he has worked with many FTSE 100 clients, Global 500 businesses and major Government entities around the world including Ford Motor Company, VAG Group, BAE Systems, GSK, AkzoNobel, RBS, HBOS, Diageo, Bacardi, Wal-Mart, British Airways, Virgin Galactic, Etisalat, British Telecom, Vodafone and Allen & Overy.
Paul also sits on the board of a number of agile, disruptive and challenger businesses whilst supporting value creation programmes for Private Equity backed businesses.
Please register here - https://us02web.zoom.us/webinar/register/WN_qRaGyPhrTDK5yGhDBs3DoQ
Stephen Wallace will be joining us from sunny Sydney to share some of his antipodean-flavoured K8S experience. He's the founder of Meetup Madness, a network of nearly 50,000 devops, data and security enthusiasts down the east coast of Australia.
Stephen's talk will cover how to setup your first Kubernetes clusters, both locally and on a cloud provider. He will cover tooling (incl Terraform), common gotyas, and some some basic deployments.
https://www.linkedin.com/in/stephenwallace
Talk 2
******
Prateek Nayak: Securing Kubernetes clusters using opensource tech and native Kubernetes objects.
Prateek is the Chief Technology Officer at Innablr, Melbourne. He help build infrastructure platforms that enable fast and secure delivery of applications to production. He has great cloud knowledge and specializes in container orchestration, scheduling, and management technologies like AWS ECS and Kubernetes. Prateek also actively helps to build a healthy community around cloud native solutions.
Speaker - Connor Reid - ECS Digital
https://www.linkedin.com/in/connor-reid-02472413/
Effective hiring is a significant challenge when attempting to achieve DevOps. Being able to build a high performing team is key to DevOps culture and the costs of poor hiring can be high.
Having spent the past seven years focusing on how to help organisations facilitate effective DevOps, I’ve gained a few battle scars along the way. In this talk, we will look at the importance of great hiring, my learnings on how to accurately attract the right people and how to create a sense of belonging within an organisation.
We will discuss how to hire for empathy, efficient ways to manage a DevOps hiring process and how to then ensure you retain your top engineering talent.
Connor looks after the growth of ECS Digital in Scotland. As their inaugural hire, Connor joined to build a greenfield technology practice to deliver DevOps to a portfolio of varied clients.
Connor has 7 years’ experience building capability squads to help organisations achieve DevOps culture. Connor also organises the DevOps Playground, a monthly, hands on meetup where software doesn’t stand still, with over 3500 members.
You can find Connor talking about technology on twitter, blogging or running the DevOps Playground in Edinburgh and London. Connor believes in a barrier free exchange of innovation and one of his largest professional goals is to become a developer of people.
Agenda:
18:00 - 18:30 - Refreshments, Pizza and Networking
18:30 - 19:15 - Connor Reid - How to Hire and Nurture Your DevOps Talent
19:15 - 20:00 - Q&A and discussions about what the group members would like to see for future events.
Speaker - Connor Reid - ECS Digital
https://www.linkedin.com/in/connor-reid-02472413/
Effective hiring is a significant challenge when attempting to achieve DevOps. Being able to build a great team is key to DevOps culture and the costs of poor hiring can be high.
Having spent the past seven years focusing on how to help organisations facilitate effective DevOps, I’ve gained a few battle scars along the way. In this talk, we will look at the importance of great hiring, my learnings on how to accurately attract the right people and how to create a sense of belonging within an organisation.
We will discuss how to hire for empathy, efficient ways to manage a DevOps hiring process and how to then ensure you retain your top engineering talent.
Connor looks after the growth of ECS Digital in Scotland. As their inaugural hire, Connor joined to build a greenfield technology practice to deliver DevOps to a portfolio of varied clients.
Connor has 7 years’ experience building capability squads to help organisations achieve DevOps culture. Connor also organises the DevOps Playground, a monthly, hands on meetup where software doesn’t stand still, with over 3500 members.
You can find Connor talking about technology on twitter, blogging or running the DevOps Playground in Edinburgh and London. Connor believes in a barrier free exchange of innovation and one of his largest professional goals is to become a developer of people.
Agenda:
18:00 - 18:30 - Refreshments, Pizza and Networking
18:30 - 19:15 - Connor Reid - How to Hire and Nurture Your DevOps Talent
19:15 - 20:00 - Q&A and discussions about what the group members would like to see for future events.
Speaker - Ricardo Sueiras - Cloud Evangelist at AWS
https://www.linkedin.com/in/ricardosueiras/
We are delighted to host our 2nd event of the year.
As Amazon has transitioned to the cloud, it moved from a monolithic architecture and waterfall based development model to a service oriented architecture based on an agile and devops methodology. Ricardo will discuss Amazon’s move to the cloud, the development and growth of Amazon Web Services (AWS), and how the devops model is implemented within AWS. Amazon’s customer focused methodology combined with devops and a flexible scaling infrastructure has allowed Amazon and AWS to significantly accelerate innovation and the delivery of new products and features.
Agenda:
18:00 - 18:30 - Refreshments, Pizza and Networking
18:30 - 19:15 - Ricardo Sueiras - DevOps At Amazon
19:15 - 20:00 - Q&A and discussions about what the group members would like to see for future events.
Expired changed:Not ExpiredEdited at by Sarah Lister
New!Title changed:Devops GlasgowURL changed:https://www.meetup.com/DevOpsGlasgowEdited at by jamesjmbtechnology