Free thoughts and words

Kindle for Reading Sheet Music and Scores

23 replies 10,733 views

Started by

Eagle

Member

Member

Opening post by Eagle

Posts
264

I don't know where to open this topic, many sections are all specialized and none are general.

That said, I was thinking of getting a Kindle, as I like its reading quality, to carry sheet music in PDF format around with me.

The screen is small, but many editions are also tiny and still readable anyway.

What do you think?

Member

Reply 3 by DiesIrae

Posts
209
City
-

I strongly advise against it because the update times when moving from one page to another could be biblical.

This is for several reasons:

1. sheet music PDFs are usually scans, so in image format

(unless they were specifically created with composition software like Sibelius), so they are somewhat heavy;

2. the processor capabilities of an e-reader are limited: great for running text files or pure PDFs, much less so for images;

3. the same goes for the display refresh: e-ink works differently from liquid crystals; a small "lag" between one page and another is found even when flipping through an e-pub, let alone with scanned PDFs. And you wouldn't just have to wait between pages... since the screen is small, you will need to zoom in and move around within the same page, with quite frustrating waiting times.

In due time (about a year ago) I tested it on a Sony e-reader, with disastrous results. I don't think the Kindle is much better.

Better iPad

Administrator

Reply 4 by Thesimon

Posts
4,504
City
Ariccia, RM

DiesIrae wrote:

iPad is better

A million times over. I have an iPad application that turns the page by listening to where we are, and so at the moment of turning it... It must be said that reading on an iPad carries the risk of blinding oneself. It doesn't read well, but it can still be useful.

Member

Reply 5 by Bit

Posts
225

I would agree if there were images in the PDF, such as the case of scores downloaded from IMSLP, etc.

To be factual, if used for what it is intended for, i.e., reading Amazon, then things change. In the meantime, a technology is being used that gives the impression of reading on paper and is indeed very restful for the eyes... I dare you to read anything with an iPad on the beach

Member

Reply 7 by stefano

Posts
205

Very interesting service, I am sure it will receive many sign-ups. I think I will get the subscription.

Member

Reply 8 by stefano

Posts
205

Simone, what is the name of the application you use on iPad to turn the pages? How does it 'listen' to where you are to turn? Do you always have to play at the same speed?

Administrator

Reply 9 by Thesimon

Posts
4,504
City
Ariccia, RM

The application is called Autoflip

To "listen," it requires the audio recording of that score, a function called auto-learning. If, hypothetically, we have the score of a Chopin nocturne and we want the program to turn the page automatically, we will first have to go to YouTube to find an existing interpretation; subsequently, we will choose the auto-learning function on the score in question, and while the audio file is playing, the application will listen and memorize each time we turn the pages following the score. Note that the pages must be turned manually for the first time during the auto-learning function. Once auto-learning is finished, the program will perform Fourier transforms by analyzing the audio recorded during learning and will store the points at which to automatically turn the page.

The fact that certain keyframes of the audio recorded during the auto-learning phase are analyzed in frequency guarantees that, regardless of speed, the application will turn the page at exactly the right moment, i.e., at the end of the score page.

I hope I have been exhaustive; if you did not understand certain steps, please feel free to ask.

Member

Reply 10 by stefano

Posts
205

Thank you. Actually, the part about the analysis with Fourier transforms is not very clear to me. A simpler explanation for those who are hopeless?

Member

Reply 11 by zenigata

Posts
70

Very, very interesting, I too am panting in anticipation of a "for dummies" explanation.

Member

Reply 12 by AbateFaria

Posts
640
City
-

It is the same procedure that PowerPoint uses to establish an irregular (but customized) automatic scan of the transition from one slide to another. There are also windshield wipers that do the same: you activate the intermittent function, use the wiper manually, and after a while, the system will know which interval you prefer to use and is suitable for that specific moment of rain

Administrator

Reply 13 by Thesimon

Posts
4,504
City
Ariccia, RM

It is a long practice to explain. Tomorrow I will try to be as precise as possible with an intuitive explanation.

Administrator

Reply 14 by Thesimon

Posts
4,504
City
Ariccia, RM

So, I haven't gone out anymore; as usual, sleep is not assisting me, so I started writing this explanation. I will try to make it as simple as possible.

What is a sound: it is the result of a body set into vibration that excites the state of rest of the air in its immediate vicinity. The air particles collide with one another and thus the sound propagates through space. For the moment, we are not interested in knowing what the directions are because that would complicate things too much. This mechanical energy, which is transferred from particle to particle, reaches our eardrum, which vibrates coherently with the excited air particles, and through a complex system—which I won't describe to avoid turning this into an encyclopedia—reaches our brain in the form of an electrical impulse, and finally, we perceive this sound.

One can therefore think of the concept of a wave. The air particles that move thanks to the vibrating body break their state of rest; in particular, they will move back and forth relative to the position of rest. This determines zones of high concentration and zones of low concentration (the concept of a wave). However, sound cannot be described simply with the concept of a wave (a pure sinusoid), otherwise, in everyday life, we would only hear pure sounds; rather, it consists of a set of pure sounds that determine the sonic timbre. We can therefore think mathematically of a wave as a function in time, meaning particles that move through space in a certain amount of time, determining, as we said before, zones of high and low concentration, but we can also think of it in an infinitely small amount of time as a set of pure tones. If we think of sound as a set of pure tones, we are looking at it in the frequency domain; that is, I am saying that at that precise temporal instant, the timbre of the sound is given by the sum of certain frequencies reaching our ear.

Below are two images to clarify the concept.

With these plugins, we have photographed the frequencies at play at a certain instant in time in a sound or set of sounds.

On the x-axis, we have the frequencies; on the y-axis, the "weight," improperly called volume, of each frequency. (The correct term would be Sound Pressure Level, or SPL, which is a logarithmic quantity consistent with our auditory system, which is also logarithmic).

I believe Autoflip is based exactly on this principle, or at least I cannot imagine any other way to make it work that way.

Using the self-learning function on Autoflip, we record the audio file we are listening to, and the app stores the point where we turned the page while following the score. Once the self-learning is finished, the recorded audio file is taken, and snapshots are taken—just like the one above—at regular intervals; even 0.5 seconds might suffice.

Why did I initially make the premise of the concept of a wave seen in time and frequency? Because at this moment we are seeing the sound in frequency, therefore the temporal variable no longer appears. Frequency recognition becomes independent of time; that is why even when playing very slowly, Autoflip will still turn the page at the right point.

Having analyzed the entire score, let's assume that Autoflip recognizes that between the 56th and 57th frequency photo, the page must be turned. How does it achieve this? With markers.

Let's place our iPad with Autoflip open on the piano and begin playing the score for which we previously performed the self-learning.

At this point, Autofflip begins to take snapshots of the frequencies (Fast Fourier Transform) in real time—snapshots of what we are playing—and if the frequency played on the piano corresponds to the first snapshot taken during the self-learning phase, it places a marker (marking it as recognized) and waits for the frequencies of the second snapshot to be played. When the frequencies of the second snapshot are played, it places the recognition marker on the second snapshot and waits for the third, and so on. When we reach the 56th snapshot, it places the marker and turns the page (since we remembered that we had posited that the page should be turned between snapshots 56 and 57 of the self-learning analysis). At this point, the same procedure continues, comparing the frequencies we play in real time with those obtained from the self-learning and placing markers, until the end of the score.

It is obvious that for this app to work well, some calibrations will have been necessary. Probably, a frequency triggering was performed, meaning a selection of the"}

most important frequencies, disregarding involuntary ones (a vacuum cleaner in the other room, a passing plane, a train), so this is necessary to avoid considering noise that can differ from place to place but also the timbral difference of different pianos. In short, identical frequencies will never be found even in the same instrument, so to guarantee the positioning of a marker, some tolerance thresholds must be given.

Obviously, I cannot know how autoflip was developed and therefore these are just my personal considerations. That is to say, if I were to implement it, I would develop it this way, also because I don't see any other possibilities... But if someone finds some documentation on the internet refuting this thesis, all welcome.

I have kept it very down-to-earth, so experts forgive some inaccuracies in terminology, but if we started talking like engineers, perhaps the message would truly reach only a few; I hope nonetheless to have cleared up your ideas.

1.png2.png

Member

Reply 15 by gianni22

Posts
159

... but what about the classic pedal command?

Administrator

Reply 16 by Thesimon

Posts
4,504
City
Ariccia, RM

There are also applications with pedal control and Bluetooth connection to the terminal. However, there are some problems. I don't think I would be able to turn the page while playing, especially if it involves very complex pieces: the pedal moves, and I would have to take my foot off the piano pedals. It is an extra action for the pianist that certainly causes distraction. Furthermore, two pedals would be needed; if there is a chorus and we need to go back one or more pages, what do we do? We could invent gestures to use only one pedal... A click on the pedal to turn forward and a double click on the pedal to go back one page, three clicks for two pages back, but it seems really cumbersome to me. Personally, I prefer someone who listens, knows where to turn, and thus replaces the page turner. The pianist plays and doesn't have to worry about anything.

Member

Reply 19 by irina85

Posts
58

very interesting but I don't understand what it means to look at a sound in the frequency domain. Can you explain?

Member

Reply 20 by stefano

Posts
205

Thank you for the explanation. Now it is much clearer to me. Intelligent use of frequencies.

Log in to participate