Government to expand stricter gathering ban to non-capital areas

Devops, CI/CD, Docker, cloud computing, software development’s “inner loop”, Kubernetes, with test data, Jenkins, GitLab CI/CD, CircleCI, far from the only, Shippable, Selenium, very active marketplace

Devops takes the overhead view encompassing the activity of both development and operations, and choreographs them to interact in the most effective ways. That is the conceptual ideal, but from a technical standpoint, can we describe the ideal devops setup?

The answer is no, because the demands of a two-person startup are radically different from those of a multi-national embarking on a microservice project with hundreds of people involved in its care and feeding.

But we can describe an idealised flow of development that flexes to absorb increasing complexity as needed, and how the technologies, like CI/CD, Docker, and cloud computing, fit into this flow.

Development: The “inner loop”

Let’s suppose you are a developer. You naturally are making changes to software, and when you are satisfied with your changes, you commit them to version control. Version control is the hinge point between software development’s “inner loop” and devops’ “outer loop.”

The developer commit may go onto a dev branch, a feature branch, or (in an informal setting) straight into main, but ideally there will be an automated run of the unit tests. This could happen in a variety of ways—via pre-commit hooks, commit hooks, the options are endless. But the upshot is that the code change will not be accepted into the branch unless the unit tests pass.

Automated testing

Now that the code change is accepted, the next meta-thing that should happen falls under the “integration test” heading, and this is the essential step in continuous integration; that is, the code is continually being integrated into the larger system (whatever it may be) and deployed for automated and manual testing in a running environment.

The sky is the limit when it comes to automated testing. Everything is on the table, with all kinds of modern automated tools available to hammer your software, from Selenium-style automated UI testing to sophisticated load testing suites. Often, some kind of automated smoke testing ensures that software promoted to test is working nominally.

The mantra of testing is, Catch problems as early as possible.

Manual validation tests

Now that the software has cleared the unit and automated integration test hurdles, it may be ready for manual testing. Usually, manual testing occurs against a specific tag that captures a specific set of features and fixes. This is the organisation (be it one person or 20) getting serious about moving the changes to production.

This means that the software is (preferably automatically) deployed to a setting that mimics production, and allows for manually interacting with it, where QA will do its best to break things. Upon finding problems, fixes can be merged in.

Once the good people in QA are satisfied, the promising package might be promoted to UA, or user acceptance testing. This can happen in a number of ways, but the bottom line is that more people (the business analysts and other stakeholders) get a crack at the running software. Once they sign off, the software is ready for production.

Monitoring changes to production

Depending on how big the changes are to production, there is more verifying activity that takes place in that setting, but a new aspect also takes hold: monitoring. Monitoring and logging are essential to keeping tabs on how the overall system is performing. This is another area that has seen vast improvements in the cloud era. A multitude of logging and monitoring tools are available.

In the realm of microservices, deploying to production is sometimes a more intricate affair, as elements of the micorservice may be deployed in phases, with network traffic being routed incrementally to the updated nodes to verify they are interacting as intended with other components.

Roles in devops

Another way to consider these processes is in terms of the roles that people play in them. By roles I mean the hats people wear, not necessarily their job titles. At the highest level, you can say there are three roles: people who modify code, people who verify that things are working properly, and people who manage running systems.

We might call them developers, testers, and admins.

As we zoom into more detail, of course, there is more diversity. For instance, a QA engineer testing new code changes is quite distinct from a business analyst verifying requirements on a UA server, both of which are distinct from a devops engineer configuring monitors to validate that production systems are running within the specified parameters. But we can say these activities fall under the broad heading of verifying things are working as they should.

Let’s use this perspective to talk about some of the specific tools these hat-wearers bring to bear in their work.

Containers: The development-operations hinge

Perhaps the most cross-cutting of technologies is containerisation, which in practice means Docker. This is because Docker allows for componentising a developer’s software into deployable chunks that define their runtime needs. That means developers can target the container, and the admins can use the container as the common denominator across systems.

The container-level deployable unit is sufficient to undergird even the most high-volume and demanding requirements. Kubernetes has become the most popular container cluster management system, and while it is not a simple piece of technology, its capabilities are impressive, with the ability to manage large clusters across multiple regions and interacting services.

Containers and development

Containerisation is not a no-brainer for the developer’s “inner loop,” however. That is because containers introduce extra complexity into the cycle of code, build, and test. Because of this, it is still more common for developers to use an “exploded” development environment, where they run their code against their local environment uncontainerised.

The unit test remains the developer’s front-line defence in code quality. Nevertheless, Docker can make some aspects simpler for the developer, such as by packaging a standardised version of a datastore like MongoDB or PostgreSQL, allowing it to be spun up with ease for developers to use when coding.

Containers and test data

By the same token, development environments can often benefit by using Docker and Docker Compose to spin up databases with test data.

So although Docker is key in unifying the devops landscape, and offers certain benefits to developers, there is some impedence mismatch when it comes down to actual coding tasks.

CI/CD pipeline tooling

Now let’s consider the tools that can be used to connect the various elements into a devops pipeline. There are many.

Run your own

The most ancient CI server is Jenkins, which remains very popular and capable. Its chief flaw is poor documentation. Virtually anything can be done with Jenkins and its universe of plug-ins, but it is often a figure-it-out-on-your-own experience.

Jenkins is a server that you install and run yourself, often on a cloud VM. It then acts as the orchestrator of things, pulling from GitHub or other version control system, running builds and tests, interacting with a Docker registry, deploying to target environments, and so on. Newer solutions include many SaaS offerings. Let’s consider a few.

SaaS options

GitLab CI/CD and CircleCI are two newer continuous integration offerings that have gained mindshare, but they are far from the only competitors in a hot space drawing new entrants hoping to solve devops problems in a convenient and effective way. Shippable is a newer option, from established vendor JFrog, that is also growing in popularity.

Testing tools

For testing, Selenium is the corollary to Jenkins in that it is free open source software you install and configure yourself. This in contrast to some of the SaaS offerings from Appium or the various cloud providers.

Like the CI/CD space, testing is a very active marketplace.

Infrastructure tooling

Infrastructure-as-code tools like AWS CloudFormation, Ansible, Chef, Puppet, and Terraform offer the ability to control the underlying systems used to host Docker and Kubernetes. A certain level of system complexity is required to merit these tools, but once that threshold is reached, they become absolutely essential to the devops process.

Automate all you can

In general, we can say that the responsibility of devops is to unite development and operations into a cohesive, collaborative system. The ideal is to automate as much as possible, and wherever human intervention is desirable, to enable repeatable, single-click execution of the necessary tasks.

Every project and organisation is a work in progress. Given the nature of software, change always involves moving the goalpost. However, a good understanding of the big picture and the tools involved allows us to plan to deal with that change and all its complexity.

News Related

OTHER NEWS

[INTERVIEW] Wisdom we learned from our seven years in US

gettyimagesbank In a memoir, author says her family’s American dream shattered but their years of struggles were worthwhile By Kang Hyun-kyung A 34-year-old author, who identifies herself only with her ... Read more »

NK leader's sister warns of 'complete destruction' of inter-Korean ties

North Korean leader`s sister Kim Yo-jong (Yonhap)The sister of North Korean leader Kim Jong-un on Wednesday accused South Korean President Moon Jae-in of being “foolish” and warned of “complete destruction” ... Read more »

US condemns N. Korean missile launch, urges Pyongyang to return to dialogue

Department of State (Yonhap)The US State Department on Wednesday condemned North Korea’s ballistic missile launches, calling the act a violation of UN Security Council resolutions that poses a threat to ... Read more »

Top diplomats of S. Korea, Britain discuss climate change, Afghanistan

South Korean Foreign Minister Chung Eui-yong (Yonhap)Foreign Minister Chung Eui-yong spoke by phone with his British counterpart, Dominic Raab, on Wednesday and discussed joint efforts on climate change and other ... Read more »

Citibank Korea set to pay huge compensation for retirees

Citibank Korea headquarters in central Seoul. Yonhap By Anna J. Park As Citibank Korea is planning to implement a voluntary retirement program, with employees applying for the program being eligible ... Read more »

Korea ranks 4th in 2021 International Earth Science Olympiad

Team Korea for the International Earth Science Olympiad 2021 / Courtesy of Korean Foundation for the Advancement of Science & Creativity By Kim Bo-eun Korea ranked fourth out of 32 ... Read more »

Vice FM meets Oman's top diplomat, discusses bilateral cooperation

Second Vice Foreign Minister Choi Jong-moon (left) speaks with Omani Foreign Minister Badr Albusaidi during his recent visit to the country. (Ministry of Foreign Affairs)Second Vice Foreign Minister Choi Jong-moon ... Read more »

Hyundai to begin car production under President's signature job project

President Moon Jae-in preorders a Casper mini SUV produced by Gwangju Global Motors, a joint venture between Hyundai Motor and Gwangju Metropolitan Government, from his office, Tuesday. Courtesy of Cheong ... Read more »

2021 F/W Seoul Fashion Week goes online from March 22

Poster for Seoul Fashion Week Fall/Winter 2021 / Courtesy of Seoul Fashion Week By Park Ji-won Seoul Fashion Week Fall/Winter 2021 will be held online from March 22 to 27. ... Read more »

6 holiday places you can stay with man's best friend

Booking.com introduces six pet-friendly stays in Korea where travelers can enjoy a vacation with their beloved animals more comfortably. Traveling with companion animals has become more popular as pet ownership ... Read more »

[INTERVIEW] UK economist calls for redirecting capitalism to make it more inclusive

Guy Standing, author of “The Precariat: The New Dangerous Class” / Courtesy of Guy Standing Guy Standing, author of ‘The Precariat,’ touts benefits of basic income, a populist idea that ... Read more »

Afghans enjoying activities after self-quarantine

Afghan evacuees enjoy outdoor activities on a playing field at the Leadership Campus of the National Human Resources Development Institute in Jincheon, North Chungcheong Province, Monday, after they underwent two ... Read more »

Block deal leads KakaoBank's stock price to drop

An employee walks into the headquarters of KakaoBank in Pangyo, Gyeonggi Province on August 5. Yonhap By Anna J. Park KakaoBank’s stock price tumbled almost eight percent on Thursday, finishing ... Read more »

Jeon Do-yeon says 'Lost' script made her cry

Actors Ryu Jun-yeol, left, and Jeon Do-yeon pose during an online press conference for JTBC’s new series, “Lost,” Thursday. Courtesy of JTBC By Kwak Yeon-soo Actress Jeon Do-yeon is returning ... Read more »

Additional airlines to resume flights to Saipan despite 4th wave of infections

An Asiana Airlines plane is seen through a window at Terminal 1 of Incheon International Airport on July 14. Yonhap Travel bubble agreement with Saipan to begin Saturday By Jun ... Read more »

Donations to Asiana Airlines' 'Change for good' campaign exceed W15 bil.

UNICEF Korea Committee Secretary General Lee Ki-cheol, second from left, and Asiana Airlines CEO Jung Sung-kwon, third from left, pose for a picture during the “Change for Good” ceremony, held ... Read more »

Financial stocks to bounce back on KakaoBank's inclusion in bank index

KakaoBank’s head office in Pangyo, Gyeonggi Province / Courtesy of KakaoBank By Lee Min-hyung Bank stocks will regain momentum for an additional rally by the end of 2021 after KakaoBank’s ... Read more »

Volvo sells over 2 million SPA-based vehicles

Volvo Cars built with SPA platforms / Courtesy of Volvo Car Korea By Kim Jae-heun Over 2 million Volvo vehicles produced with its Scalable Product Architecture (SPA) platform have been ... Read more »

'News from Nowhere' peeks into DMZ's most secluded village to ponder human conflict, isolation

An installation view of the exhibition “MMCA Hyundai Motor Series 2021: Moon Kyungwon & Jeon Joonho ― News from Nowhere, Freedom Village” at the MMCA Seoul / Courtesy of the ... Read more »

Gay culture meets sculpture to expand presence in Korea's art scene

“Bulky” (2021) by Choi Ha-neyl / Courtesy of Arario Museum By Park Han-sol Artist Choi Ha-neyl / Courtesy of Arario Museum Problems with body image can often become a source ... Read more »

KOCCA's digital showroom 'The Selects' ends F/W 2021 collection on high note

The picture shows advertisements of KOCCA’s digital showroom, “The Selects,” in Time Square. Courtesy of KOCCA By Lee Gyu-leeThe Selects, a showroom operated by the Ministry of Culture, Sports and ... Read more »

K-pop couple HyunA and DAWN flouts taboos, releases first duet mini-album

By Dong Sun-hwa K-pop couple DAWN, left, and HyunA pose during an online press conference and album showcase, Thursday. Courtesy of P NATION K-pop couple HyunA and DAWN, who went ... Read more »

Korean Air to resume flights to Hawaii in Nov.

In this June 17 photo, a Korean Air plane takes off from Incheon International Airport. Yonhap Korean Air Lines, South Korea’s biggest carrier by sales, said Thursday it plans to ... Read more »

Hyundai Motor, LG Energy break ground for battery factory in Indonesia

Hyundai logo is seen during Munich Auto Show, IAA Mobility 2021 in Munich, Germany, Sept. 8. Korean automaker Hyundai Motor Group and battery maker LG Energy Solution said Wednesday they ... Read more »

Dolce & Gabbana's 'light therapy' collection celebrates life

In this 2011 May file photo, fashion designers Stefano Gabbana, left, and Domenico Dolce arrive in downtown Milan, Italy. AP-Yonhap Dolce & Gabbana are coaxing men off their sofas and ... Read more »

LG Innotek develops eco-friendly magnet

An LG Innotek employee holds a magnet in this photo provided by the company, Monday. Courtesy of LG Innotek By Baek Byung-yeul LG Innotek developed high-efficiency, eco-friendly magnets for use ... Read more »

CCF 2021: Cultural experts underline significance of diversity, egalitarianism

France’s Secretary of State for Digital, Cedric O, speaks during the 2021 Culture Communication Forum at the Grand Hyatt Seoul, Tuesday. Courtesy of CICI By Dong Sun-hwaDigital platforms like Google ... Read more »

Author of 'Dooley' animation publishes new black humor comic book

A new comic book with the roughly translated title of “Game of Death” in English, by Kim Soo-jung, author of “Dooly, the Little Dinosaur.” Courtesy of Doolynara By Park Ji-won ... Read more »

NCSOFT vows to offer more user-friendly service for 'Blade & Soul 2'

The poster for NCSOFT’s new game, “Blade & Soul 2” / Courtesy of NCSOFT By Baek Byung-yeul Korean game company NCSOFT has vowed to offer more user-friendly services for its ... Read more »

Naver, Kakao facing uncertainty amid forthcoming regulations

Kim Beom-su, the founder and chairman of Kakao, delivers a speech at the Startup Campus in Pangyo, Gyeonggi Province, May 26, 2016. Yonhap Big tech firms hit by increased short-selling ... Read more »

Increasing infections at schools raise concerns

Students have lunch separated by clear partitions in the cafeteria of an elementary school in Gimhae, South Gyeongsang Province, Wednesday. Yonhap By Bahk Eun-ji Concerns are rising among students and ... Read more »

Screening of controversial Chinese film about Korean War canceled

A scene from the film, “The Sacrifice” / Korea Times file By Kwak Yeon-soo A screening of a Chinese film about the 1950-53 Korean War has been canceled in Korea ... Read more »

K-pop boy group LUMINOUS debuts with first album, 'YOUTH'

K-pop boy group LUMINOUS / Courtesy of Barunson WIP By Dong Sun-hwa K-pop boy group LUMINOUS, comprising Suil, Steven, Youngbin and Woobin, has debuted with its first mini-album, “YOUTH.” “YOUTH” ... Read more »

Korean firms' interim dividends surge to record high

This 2020 August file photo shows office buildings of Samsung Group in Seoul. Yonhap South Korean listed companies’ half-year dividends surged to a record high this year as their businesses ... Read more »

CCF 2021: Gov'ts should support artists affected by pandemic

Dinesh Patnaik, director general of the Indian Council for Cultural Relations, speaks at the 2021 Culture Communication Forum at the Grand Hyatt Seoul, Wednesday. Courtesy of CICI By Dong Sun-hwa ... Read more »

[INTERVIEW] Belgian filmmaker explores why young Koreans are dominating classical music

Pianist Cho Seong-jin, who won the Chopin competition in 2015, is seen in the film “K-Classics Generation” directed by Thierry Loreau. / Courtesy of K-Classics Generation By Park Ji-won It ... Read more »

Korea to lift game curfew for children

Teenagers play online games at a PC cafe in Seoul, in this March 4, 2020 photo. Korea Times file By Bahk Eun-ji The government has decided to abolish the game ... Read more »

'Men appear twice as often as women in Korean films,' data shows

The poster for “Bechdel Day 2021” / Courtesy of the Directors Guild of Korea By Kwak Yeon-soo Female actors had a big year in Korea’s top films last year. In ... Read more »

China's tougher regulations set to impact Korean game companies

From left are NCSOFT founder Kim Taek-jin, Krafton founder Chang Byung-gye and Pearl Abyss founder Kim Dae-il Pearl Abyss sheds 7.5 percent on Kosdaq By Baek Byung-yeul Korean game companies, ... Read more »