Dataflow memo ParDo edition
# Former story https://beam.apache.org/documentation/transforms/python/elementwise/pardo/ # What is Dataflow? [Have a look at this. # What is ParDo ParDo is a general-purpose processing function f
Store RSS data in Zabbix (Zabbix sender)
Last time, I described the process of storing RSS data in Zabbix using Zabbix's external check function, but it is not beautiful and it is different considering that it will be transferred to AWS Lam
Classification by k-nearest neighbor method (kNN) by python ([High school information department information II] teaching materials for teacher training)
# Introduction The k-nearest neighbor method (kNN) is a simple machine learning algorithm that determines the predicted value by taking a majority vote among the k items that are closest to the valu
Sorting image files with Python
## Preface I'm an old person, so I'm basically a "make things that don't exist" group. ## theme This time, as the title suggests, the images are sorted. Probably from around 2000, I don't know h
How to set Jupytext nicely when managing code as a team
It's painful to let someone else edit `~ / .jupyter / jupyter_notebook_config.py` with jupytext's automatic conversion settings. I have a good setting method so I will share it. ## First conclusion
[Python] Let's make matplotlib compatible with Japanese
# Overview Since matplotlib does not support Japanese with standard fonts ... <img src="https://qiita-image-store.s3.ap-northeast-1.amazonaws.com/0/672627/46a72bf0-1369-6c48-6d77-fb14258f77fa.png "
"Freedom" in AKB48 and Nogizaka46 practiced in word2vec
# Introduction By learning the lyrics of AKB48 and Nogizaka46 respectively using word2vec of the Python library, I searched for words similar to "freedom" in the lyrics of AKB48 and Nogizaka46 respec
A memo that detects and returns an image acquired from a webcam with Django's OpenCV
# background I want to detect faces from images (videos) taken with a webcam, with React and Django 
# problem https://projecteuler.net/problem=1 # English words to use https://progeigo.org/learning/essential-words-600-plus/ Words starting with A # program ``` #!/usr/bin/python3 # -*- coding:
Which day of the week do you buy gold?
# Which day is the best day to buy gold? Securities companies handle pure gold (ETFs), and the stock code 1540 is as small as about 6000 yen per stock. There is a so-called "dollar cost averaging me
I tried to rescue the data of the laptop by booting it on Ubuntu
# Target model of work - DELL Inspiron 1525（Windows Vista） It's not my laptop, but my relatives. I didn't have any recovery discs, so I was left unattended for years with an unknown password and u
Install Nginx anyway (AWS Amazon Linux 2, CentOS7 compatible, official ref. Available)
# environment --Assuming you want to install Nginx on your AWS EC2 instance --OS: Amazon Linux2 or CentOS7 (RHEL7 series) ** \ * I learned later ** --Nginx: 1.18.0 (latest, stable, as of 2020.8.31)
A note about mprotect (2)
## Overview Note that I didn't really understand the regular mprotect as a result of strace ## What is mprotect (2)? mprotect (2) is a system call that controls memory area permissions. [man mpr
[Challenger Wanted] The fastest Data Loading and Data Augmentation (Kaggle notebook) I can think of
# Introduction Well, as the title says, I've considered the fastest Data Loading and Data Augmentation on Kaggle notebook, so I'll introduce it. If you know a faster way, please let me know! The sub
Code Python to check and graph if it follows Benford's law
#### **`main.py`** ```python a=""" """ #During this time, copy the sequence of numbers from Excel etc. import collections import matplotlib.pyplot as plt a=a.split("\n") a = [x for x in a if x !=
I ran the TensorFlow tutorial with comments (first neural network: the beginning of the classification problem)
Reference URL: https://www.tensorflow.org/tutorials/keras/classification?hl=ja ## Target Do the following --Build a neural network to classify images --Training neural networks --Evaluate the p
Linux, save Makefile
It is introduced on other sites, but I will mention it in the memorandum. make 2>&1|tee make.log
Coloring points according to the distance from the regression curve
# Purpose --Depending on the distance from the straight line or curve obtained by regression analysis Change the color and density of the points to be plotted. --Visualize the distance distributio
Correspondence to ‘cannot encode object: num, of type: <class’ numpy.int64'> `in Pymongo error
## Overview As the title says ## Background I stumbled upon trying to ʻinsert` a Dict using Pymongo that obediently incorporated a Dict type value created by calculation processing via Numpy develo
I tried to step through Bayesian optimization. (With examples)
# Overview Bayesian optimization is one of the methods for finding the maximum or minimum value for an unknown function `f (x)`. Due to its nature, it is said to be suitable for the following probl
Output product information to csv using Rakuten product search API [Python]
## Introduction I used Rakuten Ichiba's API to output product information that applies to keywords to csv. I used this "Rakuten product search API". [Rakuten Web Service: Rakuten Product Search AP
I tried running the TensorFlow tutorial with comments (_TensorFlow_2_0_Introduction for beginners)
Reference URL: https://www.tensorflow.org/tutorials/quickstart/beginner?hl=ja # Target Do the following --Build a neural network to classify images --Training neural networks --Evaluate the pe
Text analysis of pub rice on Yokohama City IR
# 0. Introduction The August issue of "Public Relations Yokohama" was posted, so read it immediately. I always enjoyed reading it because I was always referred to by household consultations, such as