Okay TV - we teach Google Now to control the zombie box

“Okay Google, turn on the news!”
How convenient it would be to quickly launch any channel on a regular TV using your voice. Or control the air conditioner without having the remote control at hand.

In this article I will show how you can implement voice control of any TV without any programming or a soldering iron using a very cheap Broadlink RM controller

and a couple of Android applications.

We watch a video demonstration of the result, and then read how to do it yourself.

What kind of beast is Broadlink RM?

This is such a cheap smart home controller
that you can buy for only 3 thousand rubles. He can control any stupid technology that has an IR remote control. These can be TVs, air conditioners and many other things. In addition, he can control equipment at radio frequencies of 315 and 433 MHz - such as all kinds of switches, dimmers, and so on. In principle, all his characteristics and skills are well written here.

This thing works like an IR blaster (not to be confused with the blaster from Star Wars and all sorts of Terminators). That is, a command from any smartphone, tablet or computer is transmitted to it via regular Wi-Fi, and it already “bullets” the required IR signal in all directions.

The best TVs with voice control on the webOS platform

LG 32LM630B 32”

A special feature of this model is the process that automatically corrects the colors, thanks to which the screen will have a rich and at the same time natural image. To make the picture dynamic and contrasty, as well as suppress noise, the manufacturer used four powerful processors. Due to this, even low-quality images will be scaled, which will restore their brightness and contrast.

There is also an “Active HDR” mode, with its help each frame will be more detailed, which will also help deepen the color. This will allow you to view any content in high quality. “LG 32LM630B 32” has built-in speakers and their power is 10 W, which will allow you to enjoy clear, multi-dimensional and loud sound when watching your favorite movie. Also, due to the fact that the manufacturer installed the Dolby Audio system, the sound will not only be clear, but also voluminous, you will get the feeling that you are in a movie theater.

“LG 32LM630B 32” has the ability not only to control using voice, but also to maintain a dialogue with the user and give him the necessary advice, depending on preferences. There is also a USB port, so you can easily connect a drive to view any content. In addition, the user will be able to watch videos on Youtube or movies on Netflix.

“LG 32LM630B 32” has an elegant design and a thin edge, which will allow you to install the product in any room. The screen of this model is 32 inches in size and the resolution is 1366*768 HD.

The average cost is 17,200 rubles.

LG 32LM630B 32”

Advantages:

• High-quality image;
• Multidimensional sound;
• Functional;
• Slim body;
• Affordable price.

Flaws:

• Not detected.

NanoCell LG 49SM9000 49”

This model contains nanoparticles that will filter out colors and shades, thanks to which the user will enjoy a clear image on the screen. Also here the black color becomes deeper, due to which other shades will acquire additional brightness. The wide viewing angle should not be ignored; now, even from the side of the screen, the user will be able to fully observe what is happening. In this case, neither color nor image will be lost.

You should not ignore the alpha-7 processor, which is endowed with artificial intelligence. With it, you'll be surrounded by smart sound and smart images that adjust to your mood. Also, built-in artificial intelligence makes it possible to maintain a conversation with the “NanoCell LG 49SM9000 49” and make recommendations, following the preferences of its user. So the TV will find movies or music according to your preferences, turn off at a given time or change its style, you just have to say.

The screen diagonal of the “NanoCell LG 49SM9000 49” is 49 inches, and the resolution is 3840*2160 4K. The sound power is 40 W.

The average cost is 61,000 rubles.

NanoCell LG 49SM9000 49”

Advantages:

• High image quality;
• Powerful sound;
• Convenient control panel;
• The presence of a light sensor;
• Positive customer reviews.

Flaws:

• Not detected.

Let's get started

After the initial setup of Broadlink RM using a standard Android application, we need to teach it the IR codes on our TV remote control. So that later, when we send commands to this program, it knows what signal needs to be sent to the controller.

To do this, install the Broadlink Control application ( the source code is open

and are lying here).
It is very simple and allows you to teach Broadlink our buttons, as well as add button combinations
as functions. Because for some TV channels you need to press more than one button. For example, channel 11.

All buttons and functions are named, functions can be clicked in the list to test their operation, and you can also launch them by voice directly from the program.

When we add a new button to the program database, the controller goes into learning mode for the new IR code. The light begins to blink, we bring the control panel and press the desired button. The program will offer to name the button something and save it in the list.

This must be done for all the remote control buttons that are needed!

On topic

So, smart TV set-top boxes, also known as smart TV boxes with the AndroidTV operating system (OS), are known for their built-in (native) voice search.
You don’t have to strain yourself or enter anything manually—just press a button on the remote control, say the video title or keywords to watch the content you’re interested in. But what if your TV set-top box has a different OS than Android TV? It's okay - even if there is no built-in voice search, you can set it up yourself.

It would seem, why install anything other than Android TV at all? The answer is simple: not everyone is delighted with the interface, controls and available features. Some people prefer to use a TV set-top box with a different OS. Usually this is a full-fledged, not “stripped down” version of Android with the usual Play Market application store and other functions.

True, many are sure that when choosing Android instead of Android TV, you will have to sacrifice voice search and suffer with the remote control moving the cursor from letter to letter. But that's not true.

Learning Google Now

Google Now is a great thing for voice control.
But he doesn’t know how to click the TV buttons... Now let’s fix this shortcoming of Google engineers! As you know, Google Now does not have any open API

to “embed” your functions. But there is a Russian-language voice assistant, Dusya, who can “pull out” the text of a request from Google Now and process it if it fits one of the functions. In addition, Dusya allows you to create your own functions without any programming directly in its interface.

These “own” functions are called scripts, and they allow you to turn the user’s phrase into a certain sequence of actions that need to be performed on the smartphone. How? Using phrase templates, the syntax of which is quite simple:

* (turn on*|switch*) [to] [channel*] $Text *

Phrases like “Hey, switch to News” fit this pattern. Or “Turn on the Sports channel.” In this case, the name of the channel that needs to be launched will be placed in the $Text variable. It's simple!

As a reaction to such a command, you can add sending an intent

— that is, send a signal on the local smartphone to another program. This program will be Broadlink Control, which accepts a line of text, searches for a previously configured channel and sends button signals to Broadlink.

That's basically it!

What is voice control

Almost all TVs on the market today have the ability to connect to the Internet. Connection to the virtual network is carried out using a cable or via Wi-Fi. The remote control of such models has a special microphone through which you can give voice commands, or there is a special microphone on the TV itself that receives commands. Typically, models already have virtual assistants, or it is possible to install them yourself.

The most famous manufacturer of such equipment is. But such models are also produced by Sony, LG, Xiaomi, Panasonic and Philips. These companies are widely known among buyers and therefore all management here is thought out so as not to cause complaints from users.

Here, voice commands will completely replace the control panel. With their help, you can not only search for a program or website of interest or turn on an application, but also manage settings, adjust the volume and much more. To learn about all the possible voice commands, you can use the Help section in the TV menu. By the way, you can also open it using a voice command.

But there are commands that the TV cannot execute. Each model has its own. For example, some models will not be able to type text in the browser search bar or search for uninstalled programs or change screen settings.

There are also special consoles called Smart Boxes. By connecting them to the device, you can also perform voice control. But if the room is noisy, it will interfere with the set-top box. She will not be able to recognize the command, compare it with available information and execute it.

How to set up the remote control correctly

The remote control, which has voice control, is equipped with a microphone. With its help, the equipment will distinguish between commands and carry them out. But for everything to work correctly, you need to pair the devices. These remote controls can respond to gestures or have a touchpad, making them easier to control. Each manufacturer has its own rules for setting up such PUs.

Samsung TVs have two remote control options. The first option has a touch touchpad; such devices, as a rule, also have gestures. There are push-button remote controls that have a special button that activates a voice command. For everything to work correctly here, you need to go to the main menu and find the “System” section. In it you should select the section called “Voice control”. Now the user selects a language so that the model can understand the commands, as well as the control method. Management can be interactive or command. In the first case, it will be possible to maintain a dialogue, and in the second, the TV will strictly carry out the given commands. Once the settings are saved, the user only needs to press the microphone button and say a command, and the device will execute it.

For LG brand models everything is a little simpler. Here the remote control also has two options: push-button and touch. No preliminary settings are required for any of the options. If necessary, the user will need to click on the microphone icon, after a few seconds a search bar will appear on the screen. After the sound signal, you will need to say your request and press the result.

TVs from also have a remote control with voice control. Models released several years ago had a touch touchpad, while modern versions have a push-button remote control. But each of these options comes with a button that allows you to launch voice control. To activate this feature, the user will be required to open the main menu. Here you will find a section called “Settings” and a subsection “Network and Accessories”. Then select “Voice remote control”, where the microphone button is activated. Once everything is activated, you can use voice commands. But at the same time, you should not forget to speak directly into the microphone, the phrase must be clear, otherwise the command will not be recognized.

How to choose a good TV with voice control

Before purchasing any TV, you need to decide on the available space in the room. To do this, you will need to measure the place where the device will be installed or hung.

Now we need to think about the diagonal of the new friend. It will not always be correct to choose the largest diagonal. Here you will need to take into account the size of the room, or rather the distance from the viewing location to the screen itself. For example, if the distance is about 1.5 meters, then an option with a diagonal of 40 inches would be optimal, but if the distance is about two meters or more, then it is worth considering an option with a diagonal of 65 inches. Do not forget the fact that the larger the screen size, the more realistic the image, and there will be a deep immersion in what is happening. But at the same time, if you are very close to the screen, then all the flaws will become more noticeable. If you don’t have a very large room, but you still need a model with a large screen, then you need to make sure that the signal coming to the device is of high quality, otherwise there will be no viewing pleasure.

Also, do not ignore the display resolution. The detail of the picture will depend on this parameter. But we should not forget about the quality of the signal. Without a good signal, even the highest resolution TV will not produce a high-quality picture. Nowadays, models with 4K resolution have become very popular, but Full HD also remains popular. 4K will be ideal for watching TV series or movies, but when watching television channels it will not perform at the proper level. Also, models with 8K resolution appeared not so long ago, but the content offered here is limited, so there is no point in purchasing such a model for a couple of years.

You need to pay attention to the type of matrix. Here, each option has its own advantages, so you need to proceed from personal preferences. The LED matrix is ​​based on liquid crystals. The screens of such models are thin and do not take up much space. There is also good color rendition, with this TV you can watch both movies and enjoy video games. QLED matrices use blue LEDs for backlighting, which makes the picture brighter and more saturated. The next version of the OLED matrix. Modern technologies are used here, which not only make the picture bright, clear and contrasty, but also have deep black colors. Moreover, one should not ignore that the screens here are very thin. But such screens will fade over time.

The operating system should not be ignored either. TVs from have webOS. It has a clear interface and excellent optimization. But at the same time there are quite a few applications in the store. Many devices run on the Android TV operating system. This OS is quite understandable and well optimized, and you can also install various applications and games from the Google Play service. Models from use Tizen OS, which differs from WebOS only in the visual interface.

It would be a good idea to inquire about the number of ports and the availability of additional functions. For example, Bluetooth will make it possible to use wireless headphones, which is very useful when watching programs at night.

Well, not all of course...

Let's create such a script in Dus, add the template described above to it, and in the actions we will add sending an intent of the Broadcast type with action com.broadlink.control.action.QUERY and in the parameters we will pass our $Text variable in the text parameter. As in the screenshots:

What else can you do?

Of course, the purpose of my article is not to review the capabilities of Dusi scripts, but they really can do a lot of things. Therefore, I recommend that you seek help from the official website of the project.

And of course, you need to remember to enable integration with Google Now in the “Background Mode” setting so that Dusya can “intercept” the command from him and launch the necessary buttons on Broadlink Control.

Now, when we launch Google Now with the magic phrase “Okay Google,” we can command our cherished “Turn on Channel One,” after which Dusya will react to this phrase, close Google Now, pull out the channel name from the phrase and send it to the Broadlink Control program. It, in turn, will find by name a list of buttons that need to be pressed and send them in the correct sequence to the Broadlink RM controller. Well, he will turn the code into an IR signal and shoot it in all directions so that it will definitely reach the IR receiver of even the oldest tube TV.

The lineup

The Sony range of TVs with voice control is represented by the following models:

• KD-100ZD9
• KD-43XF7596
• KD-43XF8096
• KD-49XE8096
• KD-49XF7596
• KD-49XF8096
• KD-49XF8577
• KD-49XF9005
• KD-55AF9
• KD-55XE8096
• KD-55XE9005
• KD-55XF7596
• KD-55XF8096
• KD-55XF8577
• KD-55XF8596
• KD-55XF9005
• KD-65AF9
• KD-65S8505C
• KD-65XE9005
• KD-65XF7596
• KD-65XF8577
• KD-65XF8596
• KD-65XF9005
• KD-65ZF9
• KD-75XF9005
• KD-75ZF9
• KD-77A1
• KDL-43WF805
• KDL-49WF805
• KDL-55W808C
• KDL-55X8505C
• KDL-65W855C

The Sony KD-55XF9005 device is recognized as the best among the manufacturer's TVs.

Pros:

• Excellent image quality, screen backlight;
• UHD 4k screen, supports HDR;
• Good sound, there is a volume reserve;

Minuses:

• Inconvenient remote control;
• Inconvenient stand;
• Small glare in the corners of the screen.

In second place is the Sony KD-65AF9 TV.

Pros:

• Excellent surround sound, bass;
• OLED screen, 4k and HDR support;
• Convenient voice control;
• Nice design.

Minuses:

• Price.

Specifications

What all devices have in common is voice control of the TV. The ability to control Sony TVs with your voice appears after activating the TV with a key phrase or by pressing the microphone button on the remote control.

Device differences:

• Screen diagonal (from 43 inches to a giant with a 100-inch screen);
• Equipment and internal structure (hard drive, Bluetooth support, number of connectors);
• Design, size, weight;
• Screen quality, resolution, type, format;
• Built-in functions.

Price in stores

The cheapest Sony TV with voice control can be purchased for around 43 thousand rubles. Depending on the diagonal, quality and configuration, the price increases. The most expensive TV of this brand costs about 5 million rubles.

Where can I buy it?

You can purchase the product in electronics and household appliance stores, in online stores, as well as in Sony brand stores. Product availability must be checked on the website or with sellers.

And now that’s it for sure!

Here is an example of how, without any programming or a soldering iron, in a very short time and very little money (for a boxed solution of the “smart home” class) you can teach any equipment to be controlled by voice.
Let me remind you that Google Now can also launch on the smartphone screen that is turned off (for example, it only works on the charger for me), as well as on Android Wear smart watches. This will make a lasting impression on the guests, and in general it will be pleasant...

Okay Google, I don't watch TV!

Basic gestures and their meaning in controlling a smartphone

Regardless of the Android version, provided that manual navigation is supported, the following types of gestures can be distinguished that are present on any modern smartphone:

How to distribute Wi-Fi on Samsung

Android 10 brought a lot of surprises, including a departure from the three-button system, the ability to turn it off and manual duplication. The firmware assumes proprietary circuits. Many mobile device manufacturers have supported and created their own schemes. Gesture control on Samsung has also undergone changes. The manufacturer has slightly changed the essence of the manipulations that are presented in the proprietary One UI firmware. At the moment, the firmware is available only to owners of flagship Samsung smartphone models, but the manufacturer announced information that it will be installed on all of the company’s products. Additional touch navigation contains buttons:

Let's sum it up

Now that we've got that set up, here's how you can navigate the Galaxy S10.

• Sliding from the bottom center will take you to the start screen.
• Left swipe back
• Swiping left and holding for a second is the "task switcher"
• Sliding from the left diagonally upward is "one-handed mode"
• Right swipe is "go forward" (in web browsers)

However, if you swipe up from the bottom left or bottom right, you'll get the "recent" and "back" carousel as usual. They still work well if you use the phone with two hands or lay on a table.

(1 rating, average 4 out of 5)

Download the Google app and set it up

Previously, solving the problem required setting up a voice assistant, which required a lot of time and effort. Now everything is simpler:

• Open Play Market.
• Find the Google app. It will be first in search results.
• Install the Google app and launch it immediately.
• Open the “More” section and go to “Settings”.
• Find the “Voice Search” subsection and open it.
• Check that the options in Voice Control are enabled. Return to Voice Search.
• Select “Offline speech recognition” and make sure that the language you need is downloaded - Russian or another one that you are going to use during voice search. Go back to Voice Search.
• Be sure to activate the “Bluetooth Headset” option in Voice Search. The Android TV set-top box will treat the remote control as a headset. However, for the user there is no difference.
• Click on Voice Match in Voice Search. The application will ask for permission to record audio - confirm that you allow it.

That's all for setting up the Google application.