DOING DATA SCIENCE FROM SCRATCH TASK BY TASK

Python Flask and Vue.js for NLP

Image for post
Image for post
Photo by Science in HD on Unsplash

I am on a mini-series of posts about creating an NLP application to help people improve their resumes. The core ideas were introduced in my initial post, and in my last post, I showed how to apply a markup to specific keywords. In this post, I will show you how to hook up a Python back-end and serve that user interface I had in my last post. I hope that if I can break down these tasks into short posts, I can successfully explain my process. As of the time of writing, I have made many such applications as proof…

DOING DATA SCIENCE FROM SCRATCH TASK BY TASK

Building and adding a User Interface for NLP

Image for post
Image for post
Photo by Ed Pylypenko on Unsplash

Since I wrote my last article, Using NLP to improve your Resume, our readers’ response has been excellent. Reading some of the comments was inspiring and provided much-needed motivation for the next phases. If we really wanted to improve our Resume using NLP, we would need a User Interface, and like that Photo by Ed Pylypenko on Unsplash, our users would consume the service on their mobile.

Consider the use case that you are out and about. Your best friend sends you a job link on LinkedIn. Wouldn’t it be cool to pass that link to an application and get…

img src=”data”: how to read and save off a photo

Image for post
Image for post
Photo by Tanjir Ahmed Chowdhury on Unsplash

This past week, I worked on some Computer Vision items, and I came across a new arrangement. <img src=”data:image/png;base64,..>. Generally I was used to seeing <img src=”https….”>. After a little research, I understood this well and wanted to share what I learned with you. Naturally, I first tried to request the image URL, but that really didn’t work out. Let’s take a look at what I learned.

First, we pull in our Python modules.

import time
from selenium import webdriver
import requests
import shutil
from bs4 import BeautifulSoup from selenium…

DOING DATA SCIENCE FROM SCRATCH TASK BY TASK

Performing keyword matching and text analysis on job descriptions

Image for post
Image for post
Photo by Possessed Photography on Unsplash

Recruiters are using increasingly complicated Software and tools to scan and match Resumes to posted job positions and job specifications. If your Resume (CV) is generic, or the job specification is vague and/or generic, these tools will work against you. AI really is working against your job application, and I am not sure you know it or will accept it! But let me demonstrate some techniques that can help you balance up the odds. Naturally, we will use NLP (Natural Language Processing), Python, and some Altair visuals. Are you ready to fight back?

Consider that you are interested in a…

DOING DATA SCIENCE FROM SCRATCH TASK BY TASK

But are we generating quality on Medium?

Image for post
Image for post
Photo by Anastase Maragos on Unsplash

There seems a constant stream of Data Science Articles coming across my feed reader. Some recent articles about word clouds and Altair inspired me to use my Natural Language Processing (NLP) class once again. Given our indomitable energy I got to thinking, are we quality? The old adage of “quality over quantity” always pokes it’s nasty head up. So why don’t we go find out using Natural Language processing?

Let me explain my method, show you some of my code, and discuss what we mean by quality. Finally, I will use Altair to do some pretty visuals. Let’s go! …

DOING DATA SCIENCE FROM SCRATCH TASK BY TASK

We are counting passing vehicles with automation

Image for post
Image for post
Photo by CHUTTERSNAP on Unsplash

My project to count passing traffic would be a lot easier if I had terrific photographs such as the one above. Instead, I have low quality blurred images to work with. This article is a continuation of my personal journey on a road trip to a Computer Vision & Deep Learning Nirvana. Often times it seems more like “The road to hell” by Chris Rea. The song goes “On your journey across the wilderness from the desert to the well”. My wilderness appears to be the field of Computer Science, Deep Learning, and Computer Vision. The desert represents my thirst…

DOING DATA SCIENCE FROM SCRATCH TASK BY TASK

Things went south fast after my last all-night hack

Image for post
Image for post
Photo by Denny Müller on Unsplash

If you drive and have experienced a left front blow out, I can comfortably say I know how you feel seeing that picture from Denny Müller available on Unsplash. During my driving career, I had two dangerous blowouts. Once while entering a severe bend, I got a blowout, losing control, and that was utterly terrifying. More recently, while navigating another severe turn, I hit a rock, which shredded my left front tire. An utterly incredible and gut-wrenching experience. …

DOING DATA SCIENCE FROM SCRATCH TASK BY TASK

Configuring GPU libraries on Ubuntu 20.4 LTS

Image for post
Image for post
Photo by Kyle Hanson on Unsplash

That is me in that photo last night (December 30th, 2020). I pulled an all-nighter to configure my Linux ( Ubuntu 20.4 ) box for Deep Learning. It never gets old the myriad of dependencies, libraries, environment variables, GCC versions and optimization libraries that always throw a wobbler at some stage. Well, I certainly made a meal out of this one. Let me explain and provide you with some benchmarks. Since I am doing Data Science from Scratch, I can’t see my way to a Docker Image, pre-configured AMI, or even a VirtualBox image. That would be too easy and…

DOING DATA SCIENCE FROM SCRATCH TASK BY TASK

Some devices, in the Internet of Things, don’t have a clock.

Image for post
Image for post
Image by the author showing the NatureBytes kit: Raspberry Pi Powered Wildlife Cameras

If you have been reading my column here on Towards Data Science, you will know that I am on a mission. I wanted to count the number of cars passing my house using Computer Vision and Motion Detection. This article provides a small update and something you need to consider in designing your own Data Science experiments and data loggers. Time is an essential dimension in Computer Vision, and it is less sexy than using Neural Compute Sticks, and it certainly transcends libraries such as Cuda, OpenVision, or OpenVino. It goes right to the fundamentals of basic research.

My photo…

DOING DATA SCIENCE FROM SCRATCH TASK BY TASK

With the Intel Compute Stick

Image for post
Image for post
Image by the author — showing the authors personal Raspberry Pi 4b 8G with Intel support

If you have been reading my column here on Towards Data Science, you will know that I am on a mission. I wanted to count the number of cars passing my house using Computer Vision and Motion Detection. This article provides a small update on Computer Vision using the Intel Neural Compute Stick and the OpenVino library.

As a catch-up, I previously built a camera and then explained the need to tune the motion detection device(s). My earlier posts described the camera build and early scripts to review the data and make sense of passing traffic. We had even made…

David Moore

@CognitiveDave Digital Transformation, UX, Data Science, Tax Technology, Software Engineering, Mentor, Coach, Agile, LeanUX, Design Thinking — views are my

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store