started as a research project at UC Berkeley in the AMPLab, which focuses on big data analytics. Spark is an open source cluster computing platform designed to be fast and general-purpose for data analytics - It's both fast to run and write. Spark provides primitives for in-memory cluster computing: your job can load data into memory and query it repeatedly much quicker than with disk-based systems like Hadoop MapReduce. Users can write applications (more...)
Hadoop is an open-source software framework for storage and large-scale processing of data-sets on clusters of commodity hardware. How to deliver log to Hadoop HDFS. Apache Flume is open source to integrate with HDFS, HBASE and it's a good choice to implement for log data real-time collection from front end or log data system. Apache Flume
is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data.It uses (more...)
Good day for learning something new. After read Flume book, that something popped up in my head. Wanted to test "rsyslog" => Flume => HDFS. As we know, forwarding log to other systems. We can set rsyslog:
*.* @YOURSERVERADDRESS:YOURSERVERPORT ## for UDPFor rsyslog:
*.* @@YOURSERVERADDRESS:YOURSERVERPORT ## for TCP
[root@centos01 ~]# grep centos /etc/rsyslog.conf
Came back to Flume, I used Simple Example
for reference and changed a bit. Because (more...)
Just spread good campaign from Packt Publishing - It's a good news for people who love to learn something new - ALL eBooks and Videos are just $10 or less
-- the more you choose to learn, the more you save:
- Any 1 or 2 eBooks/Videos -- $10 each
- Any 3-5 eBooks/Videos -- $8 each
- Any 6 or more eBooks/Videos -- $6 each
As I have worked in server-side a long time as System Administrator. I must spend with logs. To use it for checking and investigation in issue. As some policies in some Companies, they want to keep logs over year or over ten years. So, it is not unusual to find out idea to store, integrate logs and do something.
A book tittle "I Heart Logs - Event Data, Stream Processing, and Data Integration"
Not Often, I checked about my space after made filesystem on Linux. Today, I have made Ext4 filesystem around 460GB, I found it 437GB only. Some path should be 50GB, but it was available only 47GB.
Thank You @OracleAlchemist
for good information about it.
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup0-U01LV 50G 52M 47G 1% /u01
Reference - (more...)
It was a quiet day, I worked as System Administrator and installed Oracle Linux on Virtual Machine guest. After installed Operating System, I wanted to extend disk on guest. So, I extended disk on guest. Anyway, I came back in my head what I was supposed to do on Linux then ?
- Create new disk (and Physical Volume) and then add in Volume Group.
Checked my partition:
My time has used much with Linux. Some people asked to move from CentOS to Oracle Linux somehow. I used to believe it easy to do like that. Anyway, It'd better to test.
I focused on 2 links.https://linux.oracle.com/switch/centos/http://docs.oracle.com/cd/E37670_01/E37355/html/ol_switch_yum.html
Oracle introduces centos2ol.sh script that can convert CentOS 5 and 6 systems to Oracle Linux. After that run "yum upgrade"
[root@test-centos ~]# uname -r
Virtual desktop infrastructure (VDI)
is the practice of hosting a desktop operating system within a virtual machine (VM) running on a centralized server. VDI is a variation on the client/server computing model, sometimes referred to as server-based computing.
VDI is the new technology that gives lots of benefits.
• Efficient use of CPU and memory resources
• Reduced desktop downtime and increased availability
• Patches and upgrades performed in data center
• New users can (more...)
- Today, it's not only developers, system administrators or organizations have use the Open Source. Businesses have established to use the Open Source as well. So, you can not ignore about Open Source. At OSCON, you'll encounter the open source ecosystem. It helps digging deep into the business of open source.
Five Reasons to Attend OSCON: Get straight to the epicenter of all things open source and get better at what you do, Learn from (more...)
focused on the intersection of software and hardware. It's great community with Software and Hardware. Audiences will be able to learn new idea to combine software and hardware. It gathered idea from engineers, researchers, roboticists, artists, founders of startups, and innovators.
Oreilly launched HD videos (Solid Conference San Francisco 2014: Complete Video Compilation Experience the revolution at the intersection of hardware and software—and imagine the future
) for this conference. Video files (more...)
Assessing overall security on a new system before it goes on-line is also a good idea. It's useful to find holes before somebody else does, verify secure configurations and testing. Penetration Testing
is the process of attempting to gain access to resources without knowledge of credentials and find security weaknesses (Interesting paper
).Penetration Testing A Hands-On Introduction to Hacking
By Georgia Weidman
. A book was written about the basic of Penetration (more...)
The Art of War
is an ancient Chinese military treatise attributed to Sun Tzu
, a high-ranking military general, strategist and tactician. A lot of books have written by using Sun Tzu's ancient The Art of War and adaptation for military, political, and business.The Art of War for Small Business Defeat the Competition and Dominate the Market with the Masterful Strategies of Sun Tzu
, this is a book was applied the Art of War for (more...)
It's time to learn more about Python. I found "Intermediate Python Practical Techniques for Deeper Skill Development" video course by Python expert Steve Holden.
It's very useful for Python video learning, but users should have basic about Python. They must install ipython.
Note start ipython by " ipython notebook" command and users can check how to install ipython?
and users should download example codes at https://github.com/DevTeam-TheOpenBastion/int-py-note
This video course gaves deeply Python learning (more...)
is programming language, that supports object-oriented, imperative and functional programming. The key is its simplicity, easy language to learn and easy moving code from development to production more quickly. It's power tool to use with Big Data. So, I believe it's a good time to learn about Python programming language.
You can find many resources about it on the Internet. I started to learn about Python by watching "Introduction to Python
" By Jessica McKellar. (more...)
Last post, I blog about Oracle Linux Beta 1
that I would like to learn more after it has changed to use Systemd targets
. In this post, I just wanted to update for some people who have installed Oracle Linux 7 Beta 1 or have been testing it. On Oracle Linux Beta 1, that uses openssl version (openssl-1.0.1e-23.el7) and it's issue about CVE-2014-0160
. Users can go Oracle Linux Early Access Downloads
and download (more...)
It might be too late posting about Oracle Linux 7 (Beta 1). Just came back from long holidays in Thailand. I think it's very interesting to learn something new in OL7. Users can download it by using OTN account.Download
After installed it, I tested some a little bit.
[root@ol7beta ~]# cat /etc/oracle-release
Oracle Linux Everything release 7.0 Beta
[root@ol7beta ~]# uname -r
Users can choose to (more...)
I got email about MapR Sandbox
, that is a fully functional Hadoop cluster running on a virtual machine (CentOS 6.5) that provides an intuitive web interface for both developers and administrators to get started with Hadoop. I belief it's a good idea to learn about Hadoop and its ecosystem. Users can download for VMware VM or VirtualBox. I downloaded for VirtualBox and imported it. I changed about network to use "Bridged Adapter". After started... (more...)
is a programming language and computing platform. There are lots of applications and websites have used it. About latest Java version, Java 8. Oracle announced Java 8
on March 25, 2014. I mention a book title - Java CookbookJava Cookbook
by Ian F. Darwin
and this book covers Java 8.
It isn't a book for someone who is new (Readers should know a bit about syntax to write Java) in Java, but It is (more...)