Vetting Brightcove Player Releases

In this topic, you will learn how Brightcove Player engineering vets player releases.

Introduction

This testing/vetting information is mostly supplied on a purely informational basis, but there might be some process you can extract for testing in your environment. For instance, some of the applicable testing scenarios might be good for you when testing custom plugins with major version releases of Brightcove Player.

The first section below lists the types of players the engineering team tests. The rest of the sections are for each player type, with the tests performed, and corresponding player results and dispatched events.

Player types

The following shows the player types/configurations tested. You will most likely chose a subset of this list. For example, if you don't use advertising with your Brightcove Player, then the IMA and FreeWheel configurations would NOT be worth your time to test.

  • Simple VOD Player
  • Player with IMA ads and bumpers - HTML
  • Player with IMA ads - Flash
  • Player with FreeWheel ads - HTML
  • Player with FreeWheel ads - Flash
  • Player with IMA ads and replay end screen
  • Autoplay with IMA ads
  • Playlist with ads
  • Player with invalid IMA ads

Simple VOD player

Tests Expected Results Important Events
Load the player. Video should load. If there is a poster image, it should be displayed.
  • player_init
  • catalog_request
  • catalog_response
  • player_load
  • video_impression
Click on the Big Play Button. Once the video plays for a few seconds, click on the play/pause control. The video should begin playing. When you hit pause, the video should pause. The play/pause control should toggle to display the correct state.
  • play_request
  • video_view
  • video_engagement
Scrub to the end of the video and hit the play/pause control again to resume video play. Let the video play until the end. You should be able to scrub to the end of the video. Hitting the play/pause toggle should resume the video. The video should continue playing until it ends.
  • play_request
  • video_engagement
  • video_complete
While you will not see the big play button again, hit the play control in the player control bar. The video should start playing from the beginning again.
  • play_request
  • video_engagement

Player with IMA Ads - HTML

Tests Expected Results Important Events
Load the player. Video should load. If there is a poster image, it should be displayed.
  • player_init
  • catalog_request
  • catalog_response
  • player_load
  • video_impression
Click on the big play button. The preroll ad should start playing. Mute the player while the ad is playing. Pause while the ad is playing. The preroll ad should begin playing. There should be no flash of content (ideally). When muted, the ad should be muted and it should pause when we hit the pause control.
  • play_request
  • ad_start
Click on the play/pause control to resume the ad. Let the ad finish, proceed to video content. Scrub through the video towards the end. The ad should resume playing and switch to the video when done. The video content should play muted too, since we muted the ad. Scrubbing to the end of the video should cause the midroll to start playing.
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
View the midroll, pause immediately after the midroll finishes playing. Transitions between ad and content should be seamless.
  • ad_end
  • play_request
Resume and watch till the end of the video. Video should end with a postroll ad.
  • play_request
  • ad_start
  • ad_end
  • video_complete

Player with IMA Ads - Flash

Tests Expected Results Important Events
Load the player. Video should load. If there is a poster image, it should be displayed.
  • player_init
  • catalog_request
  • catalog_response
  • player_load
  • video_impression
Click on the big play button. The preroll ad should start playing. Mute the player while the ad is playing. Pause while the ad is playing. The preroll ad should begin playing. There should be no flash of content (ideally). When muted, the ad should be muted and it should pause when we hit the pause control.
  • play_request
  • ad_start
Click on the play/pause control to resume the ad. Let the ad finish, proceed to video content. Scrub through the video towards the end. The ad should resume playing and switch to the video when done. The video content should play muted too, since we muted the ad. Scrubbing to the end of the video should cause the midroll to start playing.
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
View the midroll, pause immediately after the midroll finishes playing. Transitions between ad and content should be seamless.
  • ad_end
  • play_request
Resume and watch till the end of the video. Video should end with a postroll ad.
  • play_request
  • ad_start
  • ad_end
  • video_complete

Player with FreeWheel Ads - HTML

Tests Expected Results Important Events
Load the player. Video should load. If there is a poster image, it should be displayed.
  • player_init
  • catalog_request
  • catalog_response
  • player_load
  • video_impression
Click on the big play button. The preroll ad should start playing. Mute the player while the ad is playing. Pause while the ad is playing. The preroll ad should begin playing. There should be no flash of content (ideally). When muted, the ad should be muted and it should pause when we hit the pause control.
  • play_request
  • ad_start
Click on the play/pause control to resume the ad. Let the ad finish, proceed to video content. Scrub through the video towards the end. The ad should resume playing and switch to the video when done. The video content should play muted too, since we muted the ad. Scrubbing to the end of the video should cause the midroll to start playing.
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
View the midroll, pause immediately after the midroll finishes playing. Transitions between ad and content should be seamless.
  • ad_end
  • play_request
Resume and watch till the end of the video. Video should end with a postroll ad.
  • play_request
  • ad_start
  • ad_end
  • video_complete

Player with FreeWheel Ads - Flash

Tests Expected Results Important Events
Load the player. Video should load. If there is a poster image, it should be displayed.
  • player_init
  • catalog_request
  • catalog_response
  • player_load
  • video_impression
Click on the big play button. The preroll ad should start playing. Mute the player while the ad is playing. Pause while the ad is playing. The preroll ad should begin playing. There should be no flash of content (ideally). When muted, the ad should be muted and it should pause when we hit the pause control.
  • play_request
  • ad_start
Click on the play/pause control to resume the ad. Let the ad finish, proceed to video content. Scrub through the video towards the end. The ad should resume playing and switch to the video when done. The video content should play muted too, since we muted the ad. Scrubbing to the end of the video should cause the midroll to start playing.
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
View the midroll, pause immediately after the midroll finishes playing. Transitions between ad and content should be seamless.
  • ad_end
  • play_request
Resume and watch till the end of the video. Video should end with a postroll ad.
  • play_request
  • ad_start
  • ad_end
  • video_complete

Player with IMA Ads and Replay End Screen

 

Tests Expected Results Important Events
Load the player. Video should load. If there is a poster image, it should be displayed.
  • player_init
  • catalog_request
  • catalog_response
  • player_load
  • video_impression
Click on the big play button. The preroll ad should start playing. Mute the player while the ad is playing. Pause while the ad is playing. The preroll ad should begin playing. There should be no flash of content. When muted, the ad should be muted and it should pause when we hit the pause control.
  • play_request
  • ad_start
Click on the play/pause control to resume the ad. Let the ad finish, proceed to video content. Scrub through the video towards the end. The ad should resume playing and switch to the video when done. The video content should play muted too, since we muted the ad. Scrubbing to the end of the video should cause the midroll to start playing.
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
View the midroll, pause immediately after the midroll finishes playing. Transitions between ad and content should be seamless.
  • ad_end
  • play_request
Resume and watch till the end of the video. Video should end with a postroll ad and then you should see the replay end screen.
  • play_request
  • ad_start
  • ad_end
  • video_complete
Click on the replay button. The video should restart from the beginning. Note that there will be no ads during replay.
  • play_request

Autoplay with IMA Ads

Tests Expected Results Important Events
Load the player. You will not need to click on the big play button. The preroll ad should start playing. Mute the player while the ad is playing. Pause while the ad is playing. Video should load. The preroll ad should begin playing. There should be no flash of content. When muted, the ad should be muted and it should pause when you hit the pause control.
  • player_init
  • catalog_request
  • catalog_response
  • player_load
  • play_request
  • play_request
  • video_impression
  • ad_start
Click on the play/pause control to resume the ad. Let the ad finish, proceed to video content. Scrub through the video towards the end. The ad should resume playing and switch to the video when done. The video content should play muted too, since we muted the ad. Scrubbing to the end of the video should cause the midroll to start playing.
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
View the midroll, pause immediately after the midroll finishes playing. Transitions between ad and content should be seamless.
  • ad_end
  • play_request
Resume and watch till the end of the video. Video should end with a postroll ad.
  • play_request
  • ad_start
  • ad_end
  • video_complete

Playlists with Ads

 

Tests Expected Results Important Events
Load the player. Video should load. If there is a poster image, it should be displayed.
  • player_init
  • catalog_request
  • catalog_response
  • player_load
  • video_impression
Click on the big play button. The preroll ad should start playing. Mute the player while the ad is playing. Pause while the ad is playing. The preroll ad should begin playing. There should be no flash of content (ideally). When muted, the ad should be muted and it should pause when we hit the pause control. The next video in the playlist should indicate that it is coming up.
  • play_request
  • ad_start
Click on the play/pause control to resume the ad. Let the ad finish, proceed to video content. Scrub through the video towards the end. The ad should resume playing and switch to the video when done. The video content should play muted too, since we muted the ad. Scrubbing to the end of the video should cause the midroll to start playing.
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
View the midroll, pause immediately after the midroll finishes playing. Transitions between ad and content should be seamless.
  • ad_end
  • play_request
Resume and watch till the end of the video. Video should end with a postroll ad and then should proceed to show the preroll for the next video in the playlist.
  • play_request
  • ad_start
  • ad_end
  • video_complete
  • play_request
  • video_impression
  • ad_start
Once the preroll finishes, watch the video for some time. Then, click on any other video in the playlist. You should be able to switch to a new video in the playlist. The preroll for that video should begin playing, if you have watched the previous video for 30 seconds.
  • ad_end
  • video_complete
  • play_request
  • video_impression
  • ad_start
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
  • ad_end
  • play_request
  • ad_start
  • ad_end
  • video_complete
  • play_request
  • video_impression
  • ad_start
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
  • video_engagement
  • ad_end
  • video_complete

Player with Invalid IMA Ads

 

Tests Expected Results Important Events
Load the player. Video should load. If there is a poster image, it should be displayed.
  • player_init
  • catalog_request
  • catalog_response
  • player_load
  • video_impression
Hit the big play button. Let the video finish playing. There will be no pre-roll, midroll or postroll ads because the ad is invalid. Video should play without any glitches.
  • play_request
  • ad_start
  • ad_end
  • play_request
  • video_view
  • video_engagement
  • play_request
  • ad_start
  • ad_end
  • play_request
  • ad_start
  • video_engagement
  • ad_end
  • video_complete