The goal of this project is to create a simple tool to process the data provided by CommonCrawl in Python.
I wanted to do something simple. The problem was that downloading all the data from CommonCrawl requires too much space (for the compressed version, something like 53TiB) and so I required a “streaming/online solution”. Fortunately, the data is divided into segments (around 56.000). So, what my solution does is to make all the process of downloading and deleting the segments transparent. It looks it if it was a single file. It is possible to iterate by line and by WARC bloc (the format for the Internet archives).
However, this solution can be extremely long, the main limiting factor being the downloading part.
Here is an ICS calendar to easily integrate art fairs of France to your personal calendar. You can also copy the URL to integrate it into Google Calendar.
Pyformlang allows you to manipulate formal languages.
It is fully implemented in python and I tried to make the code clear enough for pedagogical purposes. The code is of course Open Source and can be found on Github. The doc is on readthedocs and pyformlang is on Pypi.
The installation is easy: pip3 install pyformlang.
It is a puzzle game which will make you think 🙂 The theme of this game jam was “Ancient Technology”. I started from the idea that, a long time ago, machines were built with ropes and so, one should be able to manipulate them very easily.
Each rope has a special power that you need to guess 😉
This is my semester project I did at ETH in the Institute of Robotics and Intelligent Systems. My advisor was George Chatzipirpiridis.
Abstract
Sensors are getting more and more popular nowadays for performance monitoring due to the high interest in Big Data and the Internet of Things. There are now use even outside industry, in a smart home or smart cities for instance. In this project, I explored ways to build a wireless sensors network in a flexible and scalable way.
Summary
In this project, I started from the open-source project Mesh Bee which I improved to be able to match our needs. A lot of low-level features were modified or improved and at the end, the results were displayed on a website. A full description of the project can be found here. All the code source can be found on Github.
During summer 2015, I participated to my first Ludum Dare. I did a game all alone : http://aun.itch.io/monster-defense. It was a lot of fun, lot of problems also, but for 48 hours, I was quite happy. I challenged myself to write everything in Scala using LibGDX. Next time, I will use Game Maker to be able to build a prototype faster.
Kudly
project aims to become kids’ new best friend, but also to help their
parents, providing them awesome features to keep close to their baby all
day long. Using new advanced technological material, Kudly is actually
the next generation of connected cuddly bears.
Starting
with the morning, we decided to focus on how to make the child wake up
gently. Kudly will offer the possibility for the parents to program a
musical clock, and it will even be able to wake the child up using
recorded parents’ voice, as if they were there.
Yet,
what happen when the child wakes up earlier in the night ? When their
kid will move, start crying or play with Kudly, parents will be
notificated on their smartphone. This will be possible using an
accelerometer and a gyroscope, an infrared presence sensor and an
embedded microphone detecting whether or not the child has woken up.
Imagine how nice it would be to let your children rest a few hours more
with a soft music or keep him busy playing with his Kudly.
Childhood
is an ephemeral moment, going through so fastly, a moment of which you
want to remember. Kudly will be there to take photographs of you child
and will provide you an online photo album.
How
can we avoid the child to be bored by his soft toy ? Simply by making
Kudly evolve at his rhythm thanks to educative programs adapted to the
kid and availables online. Thus, a child who learns the alphabet or
algebra will be helped by Kudly during his learning. Kudly will give
instructions to the child through its speaker and will interact with him
using LEDs and various sensors in its body. So what about teaching
different languages or mathematics to the child?
Your child’s health is your main concern. In particular, we can think
about the environment where he lives every day, like his bedroom. Data
such as the ambiant temperature will be available immediately on your
smartphone, thanks to Kudly’s temperature sensor.
Finally,
we didn’t forget that a soft toy is done for being cuddled. Kudly is
equipped with pressure sensors which allows it to know when he’s
cuddled. Then, he will be able to answer and interact with the child
using sweet words.
The aim of this project is to create a toy which will be as useful for children and parents. Kudly grows up at the same rhythm as the child, to offer a personalized follow-up which will delight young children as well as adults.
