{"id":5231,"date":"2024-01-17T06:15:34","date_gmt":"2024-01-17T06:15:34","guid":{"rendered":"https:\/\/test.opensource-db.in\/wp1\/?p=5231"},"modified":"2024-02-05T06:43:40","modified_gmt":"2024-02-05T06:43:40","slug":"open-source-data-engineering-with-postgresql-2","status":"publish","type":"post","link":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/","title":{"rendered":"Open-source Data Engineering with PostgreSQL"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\">Blog-2: Installation and Setup on Ubuntu<\/h3>\n\n\n\n<h4 class=\"wp-block-heading\">INTRODUCTION:<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">Welcome back to the series on <strong>Open-source Data Engineering with PostgreSQL<\/strong>. In this post, we shall delve into the installation and configuration of Apache Spark and Apache Drill on an Ubuntu environment. Our aim is to guide you through each step, building upon the foundational concepts we&#8217;ve previously covered. By following this comprehensive walkthrough, you&#8217;ll have all the necessary prerequisites for a streamlined installation process, setting the stage for an optimized data engineering environment that facilitates efficient data loading and exploration. Let&#8217;s dive in and set the stage for a seamlessly integrated experience.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Prerequisites:<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Before we embark on the installation journey, make sure your Ubuntu operating&nbsp; system meets the following prerequisites:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Sufficient Disk storage<\/li>\n\n\n\n<li>Apache Spark and Apache Drill require Java version Java 8 or Java 11 to run\n<ul class=\"wp-block-list\">\n<li>Here is the command to install Java if it is not already installed\n<ul class=\"wp-block-list\">\n<li>sudo apt-get install openjdk-8-jdk<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Apache spark interacts with various data sources, including PostgreSQL. To connect to a Postgres database, we need a PostgreSQL JDBC Driver; we can download it from h<a href=\"https:\/\/jdbc.postgresql.org\/download\/\">https:\/\/jdbc.postgresql.org\/download\/<\/a><\/li>\n\n\n\n<li>Place the PostgreSQL JDBC Driver JAR file in this location <code>\/opt\/spark\/jars<\/code>  so that is accessible to Apache Spark.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Installation and setup<\/h3>\n\n\n\n<h3 class=\"wp-block-heading\">Apache Spark:<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Download the latest Apache Spark utility (version 3.5.0 as of this writing) from this link <a href=\"https:\/\/spark.apache.org\/downloads.html\" target=\"_blank\" rel=\"noreferrer noopener\">https:\/\/spark.apache.org\/downloads.html<\/a>, we can download any other available version as per the need.<\/li>\n\n\n\n<li>First, we will update using the command<br><code>sudo apt-get update<\/code><br><code>sudo apt-get upgrade<\/code><\/li>\n\n\n\n<li>Use this command to extract the tarball and before that change the directory where we want to extract spark<br><code>cd \/path\/to\/your\/desired\/directory<\/code><br><code>tar -xzf spark-3.5.0-bin-hadoop3.tar.gz<\/code><\/li>\n\n\n\n<li>Update your .bashrc file with the following environment variables<br><code>export HADOOP_HOME=\/path\/to\/your\/hadoop<\/code><br><code>export SPARK_HOME=\/path\/to\/your\/spark<\/code><\/li>\n\n\n\n<li>Navigate to the Spark directory and run the following command, we can see the Spark working directory<br><code>cd \/path\/to\/your\/spark<\/code><br><code>spark-shell<\/code><\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"251\" src=\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02-1024x251.png\" alt=\"\" class=\"wp-image-5232\" srcset=\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02-1024x251.png 1024w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02-300x74.png 300w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02-768x188.png 768w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02-404x99.png 404w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02-326x80.png 326w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02-394x97.png 394w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02-915x224.png 915w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02-1240x304.png 1240w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-16-22-19-02.png 1309w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">Apache Drill:<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Download the latest version of Apache Drill (version 1.19.0 as of this writing) using<br><code>wget https:\/\/www.apache.org\/dyn\/closer.cgi\/drill\/drill-1.19.0\/apache-drill-1.19.0.tar.gz<\/code><\/li>\n\n\n\n<li>Firstly we will run&nbsp;<br><code>sudo apt-get update<\/code><br><code>sudo apt-get upgrade<\/code><\/li>\n\n\n\n<li>Use the following command to extract the tarball at the desired directory&nbsp;<br><code>cd \/path\/to\/your\/desired\/directory<\/code><br><code>tar -xvf apache-drill-1.19.0.tar.gz<\/code><\/li>\n\n\n\n<li>Navigate to the Drill&#8217;s bin directory and run any of the following commands to start the Drill shell or the sqlline shell:<br><code>.\/drill-embedded<\/code><br><code>.\/sqlline<\/code><br>.<code>\/sqlline -u jdbc:drill:zk=local<\/code><\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"609\" height=\"151\" src=\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-28-40.png\" alt=\"\" class=\"wp-image-5233\" srcset=\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-28-40.png 609w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-28-40-300x74.png 300w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-28-40-399x99.png 399w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-28-40-323x80.png 323w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-28-40-394x98.png 394w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-28-40-605x151.png 605w\" sizes=\"(max-width: 609px) 100vw, 609px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"862\" height=\"95\" src=\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-41-39.png\" alt=\"\" class=\"wp-image-5234\" srcset=\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-41-39.png 862w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-41-39-300x33.png 300w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-41-39-768x85.png 768w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-41-39-726x80.png 726w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-41-39-394x43.png 394w\" sizes=\"(max-width: 862px) 100vw, 862px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"825\" height=\"97\" src=\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-42-38.png\" alt=\"\" class=\"wp-image-5235\" srcset=\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-42-38.png 825w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-42-38-300x35.png 300w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-42-38-768x90.png 768w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-42-38-680x80.png 680w, https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/Screenshot-from-2024-01-17-00-42-38-394x46.png 394w\" sizes=\"(max-width: 825px) 100vw, 825px\" \/><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\">What&#8217;s next:<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">This installation guide has equipped you with the essential steps to set up Apache Spark and Apache Drill on your Ubuntu environment. By following these instructions, you&#8217;ve laid a solid foundation for efficient data engineering, enabling seamless data loading and exploration.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As you embark on your journey with Spark and Drill, remember that this is just the beginning. In upcoming blogs, we will delve deeper into advanced configurations, optimization strategies, and real-world use cases. Stay tuned for more insights and practical tips that will elevate your data engineering experience. The upcoming blogs will provide valuable insights for harnessing the full potential of Apache Spark and Apache Drill in your data projects. Happy exploring!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Blog-2: Installation and Setup on Ubuntu INTRODUCTION: Welcome back to the series on Open-source Data Engineering with PostgreSQL. In this [&hellip;]<\/p>\n","protected":false},"author":10,"featured_media":5415,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[1,23,42,89],"tags":[107,81,106,26],"class_list":["post-5231","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-others","category-postgresql-14","category-postgresql-15","category-postgresql-16","tag-apache-spark","tag-data-engineering","tag-drill","tag-postgresql"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Open-source Data Engineering with PostgreSQL - OpenSource DB<\/title>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Open-source Data Engineering with PostgreSQL - OpenSource DB\" \/>\n<meta property=\"og:description\" content=\"Blog-2: Installation and Setup on Ubuntu INTRODUCTION: Welcome back to the series on Open-source Data Engineering with PostgreSQL. In this [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/\" \/>\n<meta property=\"og:site_name\" content=\"OpenSource DB\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/people\/OpenSource-DB\/100072970755470\/\" \/>\n<meta property=\"article:published_time\" content=\"2024-01-17T06:15:34+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-02-05T06:43:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1800\" \/>\n\t<meta property=\"og:image:height\" content=\"945\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Brahmini Ratnam\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@opensource_db\" \/>\n<meta name=\"twitter:site\" content=\"@opensource_db\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Brahmini Ratnam\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/\"},\"author\":{\"name\":\"Brahmini Ratnam\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/person\/867a56696ebca29a93489ed53609f301\"},\"headline\":\"Open-source Data Engineering with PostgreSQL\",\"datePublished\":\"2024-01-17T06:15:34+00:00\",\"dateModified\":\"2024-02-05T06:43:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/\"},\"wordCount\":470,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#organization\"},\"image\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png\",\"keywords\":[\"apache spark\",\"data-engineering\",\"drill\",\"postgresql\"],\"articleSection\":[\"Others\",\"PostgreSQL 14\",\"PostgreSQL 15\",\"PostgreSQL 16\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/\",\"url\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/\",\"name\":\"Open-source Data Engineering with PostgreSQL - OpenSource DB\",\"isPartOf\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png\",\"datePublished\":\"2024-01-17T06:15:34+00:00\",\"dateModified\":\"2024-02-05T06:43:40+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#primaryimage\",\"url\":\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png\",\"contentUrl\":\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png\",\"width\":1800,\"height\":945},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/test.opensource-db.in\/wp1\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Open-source Data Engineering with PostgreSQL\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#website\",\"url\":\"https:\/\/test.opensource-db.in\/wp1\/\",\"name\":\"OpenSource DB\",\"description\":\"Your Trusted OpenSource Databases partner\",\"publisher\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/test.opensource-db.in\/wp1\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#organization\",\"name\":\"OPENSOURCE DB PRIVATE LIMITED\",\"url\":\"https:\/\/test.opensource-db.in\/wp1\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2021\/10\/osdb-logo-tm-2.png\",\"contentUrl\":\"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2021\/10\/osdb-logo-tm-2.png\",\"width\":368,\"height\":120,\"caption\":\"OPENSOURCE DB PRIVATE LIMITED\"},\"image\":{\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/people\/OpenSource-DB\/100072970755470\/\",\"https:\/\/x.com\/opensource_db\",\"https:\/\/www.youtube.com\/channel\/UCmTI5h\",\"https:\/\/www.linkedin.com\/company\/opensource-db\",\"https:\/\/www.instagram.com\/opensource_db\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/person\/867a56696ebca29a93489ed53609f301\",\"name\":\"Brahmini Ratnam\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/05bcc95d3352ddae501c8cdae6b20b8e4e59c373cb7e506042427bca7fe13a3b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/05bcc95d3352ddae501c8cdae6b20b8e4e59c373cb7e506042427bca7fe13a3b?s=96&d=mm&r=g\",\"caption\":\"Brahmini Ratnam\"},\"url\":\"https:\/\/test.opensource-db.in\/wp1\/author\/brahmini-ratnam-meruva\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Open-source Data Engineering with PostgreSQL - OpenSource DB","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"Open-source Data Engineering with PostgreSQL - OpenSource DB","og_description":"Blog-2: Installation and Setup on Ubuntu INTRODUCTION: Welcome back to the series on Open-source Data Engineering with PostgreSQL. In this [&hellip;]","og_url":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/","og_site_name":"OpenSource DB","article_publisher":"https:\/\/www.facebook.com\/people\/OpenSource-DB\/100072970755470\/","article_published_time":"2024-01-17T06:15:34+00:00","article_modified_time":"2024-02-05T06:43:40+00:00","og_image":[{"width":1800,"height":945,"url":"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png","type":"image\/png"}],"author":"Brahmini Ratnam","twitter_card":"summary_large_image","twitter_creator":"@opensource_db","twitter_site":"@opensource_db","twitter_misc":{"Written by":"Brahmini Ratnam","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#article","isPartOf":{"@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/"},"author":{"name":"Brahmini Ratnam","@id":"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/person\/867a56696ebca29a93489ed53609f301"},"headline":"Open-source Data Engineering with PostgreSQL","datePublished":"2024-01-17T06:15:34+00:00","dateModified":"2024-02-05T06:43:40+00:00","mainEntityOfPage":{"@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/"},"wordCount":470,"commentCount":0,"publisher":{"@id":"https:\/\/test.opensource-db.in\/wp1\/#organization"},"image":{"@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#primaryimage"},"thumbnailUrl":"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png","keywords":["apache spark","data-engineering","drill","postgresql"],"articleSection":["Others","PostgreSQL 14","PostgreSQL 15","PostgreSQL 16"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/","url":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/","name":"Open-source Data Engineering with PostgreSQL - OpenSource DB","isPartOf":{"@id":"https:\/\/test.opensource-db.in\/wp1\/#website"},"primaryImageOfPage":{"@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#primaryimage"},"image":{"@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#primaryimage"},"thumbnailUrl":"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png","datePublished":"2024-01-17T06:15:34+00:00","dateModified":"2024-02-05T06:43:40+00:00","breadcrumb":{"@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#primaryimage","url":"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png","contentUrl":"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png","width":1800,"height":945},{"@type":"BreadcrumbList","@id":"https:\/\/test.opensource-db.in\/wp1\/open-source-data-engineering-with-postgresql-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/test.opensource-db.in\/wp1\/"},{"@type":"ListItem","position":2,"name":"Open-source Data Engineering with PostgreSQL"}]},{"@type":"WebSite","@id":"https:\/\/test.opensource-db.in\/wp1\/#website","url":"https:\/\/test.opensource-db.in\/wp1\/","name":"OpenSource DB","description":"Your Trusted OpenSource Databases partner","publisher":{"@id":"https:\/\/test.opensource-db.in\/wp1\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/test.opensource-db.in\/wp1\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/test.opensource-db.in\/wp1\/#organization","name":"OPENSOURCE DB PRIVATE LIMITED","url":"https:\/\/test.opensource-db.in\/wp1\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/logo\/image\/","url":"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2021\/10\/osdb-logo-tm-2.png","contentUrl":"https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2021\/10\/osdb-logo-tm-2.png","width":368,"height":120,"caption":"OPENSOURCE DB PRIVATE LIMITED"},"image":{"@id":"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/people\/OpenSource-DB\/100072970755470\/","https:\/\/x.com\/opensource_db","https:\/\/www.youtube.com\/channel\/UCmTI5h","https:\/\/www.linkedin.com\/company\/opensource-db","https:\/\/www.instagram.com\/opensource_db\/"]},{"@type":"Person","@id":"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/person\/867a56696ebca29a93489ed53609f301","name":"Brahmini Ratnam","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/test.opensource-db.in\/wp1\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/05bcc95d3352ddae501c8cdae6b20b8e4e59c373cb7e506042427bca7fe13a3b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/05bcc95d3352ddae501c8cdae6b20b8e4e59c373cb7e506042427bca7fe13a3b?s=96&d=mm&r=g","caption":"Brahmini Ratnam"},"url":"https:\/\/test.opensource-db.in\/wp1\/author\/brahmini-ratnam-meruva\/"}]}},"rttpg_featured_image_url":{"full":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png",1800,945,false],"landscape":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png",1800,945,false],"portraits":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png",1800,945,false],"thumbnail":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3-150x150.png",150,150,true],"medium":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3-300x158.png",300,158,true],"large":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3-1024x538.png",1024,538,true],"1536x1536":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3-1536x806.png",1536,806,true],"2048x2048":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png",1800,945,false],"ultp_layout_landscape_large":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png",1200,630,false],"ultp_layout_landscape":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png",870,457,false],"ultp_layout_portrait":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png",600,315,false],"ultp_layout_square":["https:\/\/test.opensource-db.in\/wp1\/wp-content\/uploads\/2024\/01\/image-3.png",600,315,false]},"rttpg_author":{"display_name":"Brahmini Ratnam","author_link":"https:\/\/test.opensource-db.in\/wp1\/author\/brahmini-ratnam-meruva\/"},"rttpg_comment":0,"rttpg_category":"<a href=\"https:\/\/test.opensource-db.in\/wp1\/category\/business\/others\/\" rel=\"category tag\">Others<\/a> <a href=\"https:\/\/test.opensource-db.in\/wp1\/category\/postgres\/postgresql-14\/\" rel=\"category tag\">PostgreSQL 14<\/a> <a href=\"https:\/\/test.opensource-db.in\/wp1\/category\/postgres\/postgresql-15\/\" rel=\"category tag\">PostgreSQL 15<\/a> <a href=\"https:\/\/test.opensource-db.in\/wp1\/category\/postgres\/postgresql-16\/\" rel=\"category tag\">PostgreSQL 16<\/a>","rttpg_excerpt":"Blog-2: Installation and Setup on Ubuntu INTRODUCTION: Welcome back to the series on Open-source Data Engineering with PostgreSQL. In this [&hellip;]","_links":{"self":[{"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/posts\/5231","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/comments?post=5231"}],"version-history":[{"count":13,"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/posts\/5231\/revisions"}],"predecessor-version":[{"id":6226,"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/posts\/5231\/revisions\/6226"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/media\/5415"}],"wp:attachment":[{"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/media?parent=5231"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/categories?post=5231"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/test.opensource-db.in\/wp1\/wp-json\/wp\/v2\/tags?post=5231"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}