Обсуждение: Re: pgsql: Add parallel-aware hash joins.
On Fri, Dec 22, 2017 at 9:22 PM, Andres Freund <andres@anarazel.de> wrote: > On 2017-12-22 21:16:10 +1300, Thomas Munro wrote: >> Andres, your machine francolin crashed -- got a core file? > > Unfortunately not - it appears the buildfarm cleared it away :( I now have a workload that fails within a few minutes or so on master. I see the problem: MultiExecParallelHash() needs to run sts_end_write() *before* detaching from grow_batches_barrier. My test case doesn't fail with the attached patch applied. I'll address the instability of the regression test output separately. Sorry for the delay, due to the time of year. -- Thomas Munro http://www.enterprisedb.com
Вложения
On Thu, Jan 4, 2018 at 11:00 AM, Tom Lane <tgl@sss.pgh.pa.us> wrote: > Also, what the devil is happening on skink? I looked at the server log for the first of the two skink failures. The key lines seem to be: 2018-01-04 07:45:36.764 UTC [5a4ddb98.5a97:154] LOG: statement: DROP SCHEMA testschema CASCADE; 2018-01-04 07:45:36.922 UTC [5a4ddb98.5a97:155] LOG: statement: DROP ROLE regress_tablespace_user1; 2018-01-04 07:45:36.941 UTC [5a4ddb98.5a97:156] LOG: statement: DROP ROLE regress_tablespace_user2; 2018-01-04 07:45:36.963 UTC [5a4ddb98.5a97:157] LOG: disconnection: session time: 0:00:08.472 user=andres database=regression host=[local] ...lines from other backends indicating new connections... 2018-01-04 07:45:37.289 UTC [5a4ddb92.2b65:4] LOG: server process (PID 23191) exited with exit code 128 2018-01-04 07:45:37.290 UTC [5a4ddb92.2b65:5] LOG: terminating any other active server processes So, skink is apparently dying during shutdown of a user-connected backend, and specifically the one that executed the 'tablespace' test. That test itself passed, but then afterward the backend fell over and died horribly. Interestingly, I see multiple other messages in the logs indicating similar failures: 2018-01-04 07:45:37.821 UTC [5a4ddb92.2b65:6] LOG: statistics collector process (PID 20842) exited with exit code 128 2018-01-04 07:46:08.113 UTC [5a4ddb92.2b65:9] LOG: server process (PID 29128) exited with exit code 128 2018-01-04 07:46:08.293 UTC [5a4ddb92.2b65:11] LOG: statistics collector process (PID 29059) exited with exit code 128 2018-01-04 07:46:26.384 UTC [5a4ddb92.2b65:14] LOG: server process (PID 13787) exited with exit code 128 2018-01-04 07:46:27.122 UTC [5a4ddb92.2b65:16] LOG: statistics collector process (PID 13776) exited with exit code 128 This is a valgrind animal. I don't know if that might be related somehow. -- Robert Haas EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company
Robert Haas <robertmhaas@gmail.com> writes:
> On Thu, Jan 4, 2018 at 11:00 AM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>> Also, what the devil is happening on skink?
> So, skink is apparently dying during shutdown of a user-connected
> backend, and specifically the one that executed the 'tablespace' test.
Well, yeah, valgrind is burping: the postmaster log is full of
==10544== VALGRINDERROR-BEGIN
==10544== Syscall param epoll_pwait(sigmask) points to unaddressable byte(s)
==10544== at 0x7011490: epoll_pwait (epoll_pwait.c:42)
==10544== by 0x4BF40B: WaitEventSetWaitBlock (latch.c:1048)
==10544== by 0x4BF40B: WaitEventSetWait (latch.c:1000)
==10544== by 0x3C0B3B: secure_read (be-secure.c:166)
==10544== by 0x3CCD9E: pq_recvbuf (pqcomm.c:963)
==10544== by 0x3CDA07: pq_getbyte (pqcomm.c:1006)
==10544== by 0x4E2A2D: SocketBackend (postgres.c:339)
==10544== by 0x4E444E: ReadCommand (postgres.c:512)
==10544== by 0x4E7588: PostgresMain (postgres.c:4085)
==10544== by 0x4641D0: BackendRun (postmaster.c:4412)
==10544== by 0x467308: BackendStartup (postmaster.c:4084)
==10544== by 0x4675F7: ServerLoop (postmaster.c:1757)
==10544== by 0x4689D4: PostmasterMain (postmaster.c:1365)
==10544== Address 0x0 is not stack'd, malloc'd or (recently) free'd
==10544==
==10544== VALGRINDERROR-END
But (a) this is happening in multiple branches, and (b) we've not
changed anything near that code in awhile. I think something broke
in valgrind itself.
regards, tom lane
On 2018-01-04 12:11:37 -0500, Tom Lane wrote: > Robert Haas <robertmhaas@gmail.com> writes: > > On Thu, Jan 4, 2018 at 11:00 AM, Tom Lane <tgl@sss.pgh.pa.us> wrote: > >> Also, what the devil is happening on skink? > > > So, skink is apparently dying during shutdown of a user-connected > > backend, and specifically the one that executed the 'tablespace' test. > > Well, yeah, valgrind is burping: the postmaster log is full of > > ==10544== VALGRINDERROR-BEGIN > ==10544== Syscall param epoll_pwait(sigmask) points to unaddressable byte(s) > ==10544== at 0x7011490: epoll_pwait (epoll_pwait.c:42) > ==10544== by 0x4BF40B: WaitEventSetWaitBlock (latch.c:1048) > ==10544== by 0x4BF40B: WaitEventSetWait (latch.c:1000) > ==10544== by 0x3C0B3B: secure_read (be-secure.c:166) > ==10544== by 0x3CCD9E: pq_recvbuf (pqcomm.c:963) > ==10544== by 0x3CDA07: pq_getbyte (pqcomm.c:1006) > ==10544== by 0x4E2A2D: SocketBackend (postgres.c:339) > ==10544== by 0x4E444E: ReadCommand (postgres.c:512) > ==10544== by 0x4E7588: PostgresMain (postgres.c:4085) > ==10544== by 0x4641D0: BackendRun (postmaster.c:4412) > ==10544== by 0x467308: BackendStartup (postmaster.c:4084) > ==10544== by 0x4675F7: ServerLoop (postmaster.c:1757) > ==10544== by 0x4689D4: PostmasterMain (postmaster.c:1365) > ==10544== Address 0x0 is not stack'd, malloc'd or (recently) free'd > ==10544== > ==10544== VALGRINDERROR-END > > But (a) this is happening in multiple branches, and (b) we've not > changed anything near that code in awhile. I think something broke > in valgrind itself. Some packages on skink have been upgraded. It appears that there either was a libc or valgrind change that made valgrind not recognize that a pointer of 0 might not point anywhere :( Let me check whether valgrind accept multiple suppression files, in which case I could add a suppression for this error to all branches. Will also check whether I can reproduce locally. Greetings, Andres Freund
On 2018-01-04 11:20:33 -0800, Andres Freund wrote:
> On 2018-01-04 12:11:37 -0500, Tom Lane wrote:
> > Robert Haas <robertmhaas@gmail.com> writes:
> > > On Thu, Jan 4, 2018 at 11:00 AM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
> > >> Also, what the devil is happening on skink?
> >
> > > So, skink is apparently dying during shutdown of a user-connected
> > > backend, and specifically the one that executed the 'tablespace' test.
> >
> > Well, yeah, valgrind is burping: the postmaster log is full of
> >
> > ==10544== VALGRINDERROR-BEGIN
> > ==10544== Syscall param epoll_pwait(sigmask) points to unaddressable byte(s)
> > ==10544== at 0x7011490: epoll_pwait (epoll_pwait.c:42)
> > ==10544== by 0x4BF40B: WaitEventSetWaitBlock (latch.c:1048)
> > ==10544== by 0x4BF40B: WaitEventSetWait (latch.c:1000)
> > ==10544== by 0x3C0B3B: secure_read (be-secure.c:166)
> > ==10544== by 0x3CCD9E: pq_recvbuf (pqcomm.c:963)
> > ==10544== by 0x3CDA07: pq_getbyte (pqcomm.c:1006)
> > ==10544== by 0x4E2A2D: SocketBackend (postgres.c:339)
> > ==10544== by 0x4E444E: ReadCommand (postgres.c:512)
> > ==10544== by 0x4E7588: PostgresMain (postgres.c:4085)
> > ==10544== by 0x4641D0: BackendRun (postmaster.c:4412)
> > ==10544== by 0x467308: BackendStartup (postmaster.c:4084)
> > ==10544== by 0x4675F7: ServerLoop (postmaster.c:1757)
> > ==10544== by 0x4689D4: PostmasterMain (postmaster.c:1365)
> > ==10544== Address 0x0 is not stack'd, malloc'd or (recently) free'd
> > ==10544==
> > ==10544== VALGRINDERROR-END
> >
> > But (a) this is happening in multiple branches, and (b) we've not
> > changed anything near that code in awhile. I think something broke
> > in valgrind itself.
>
> Some packages on skink have been upgraded. It appears that there either
> was a libc or valgrind change that made valgrind not recognize that a
> pointer of 0 might not point anywhere :(
It looks like recent glibc implements epoll_wait() as epoll_pwait() with
a NULL sigmask argument, and valgrind isn't happy with it.
> Let me check whether valgrind accept multiple suppression files, in
> which case I could add a suppression for this error to all
> branches.
Done that. I've added a valgrind-global.supp that has:
{
null-sigmask-to-pwait-means-no-sigmask
Memcheck:Param
epoll_pwait(sigmask)
fun:epoll_pwait
fun:WaitEventSetWaitBlock
}
> Will also check whether I can reproduce locally.
Locally the above suppression allowed me to continue a bit further. But
I promptly hit other new blurbs:
assert build:
2018-01-04 12:03:45.927 PST [5716][3/189] STATEMENT: select format('%1$s %4$s', 1, 2, 3);
==5718== Invalid write of size 8
==5718== at 0x40E3DD: ExecInterpExpr (execExprInterp.c:1117)
==5718== by 0x40F5E9: ExecInterpExprStillValid (execExprInterp.c:1788)
==5718== by 0xE6B0409: ExecEvalExpr (executor.h:282)
==5718== by 0xE6BA6EA: exec_eval_simple_expr (pl_exec.c:5602)
==5718== by 0xE6B9DBB: exec_eval_expr (pl_exec.c:5197)
==5718== by 0xE6B5A4B: exec_stmt_raise (pl_exec.c:3230)
==5718== by 0xE6B2C04: exec_stmt (pl_exec.c:1632)
==5718== by 0xE6B2956: exec_stmts (pl_exec.c:1535)
==5718== by 0xE6B27FC: exec_stmt_block (pl_exec.c:1473)
==5718== by 0xE6B083E: plpgsql_exec_function (pl_exec.c:474)
==5718== by 0xE6AB13C: plpgsql_inline_handler (pl_handler.c:330)
==5718== by 0x76C2B9: OidFunctionCall1Coll (fmgr.c:1327)
==5718== by 0x3A28CA: ExecuteDoStmt (functioncmds.c:2234)
==5718== by 0x5F92EB: standard_ProcessUtility (utility.c:532)
==5718== by 0x5F8E26: ProcessUtility (utility.c:357)
==5718== by 0x5F7D9F: PortalRunUtility (pquery.c:1178)
==5718== by 0x5F7FC0: PortalRunMulti (pquery.c:1324)
==5718== by 0x5F74DE: PortalRun (pquery.c:799)
==5718== by 0x5F10BE: exec_simple_query (postgres.c:1120)
==5718== by 0x5F5640: PostgresMain (postgres.c:4143)
==5718== Address 0x20 is not stack'd, malloc'd or (recently) free'd
==5718==
{
<insert_a_suppression_name_here>
Memcheck:Addr8
fun:ExecInterpExpr
fun:ExecInterpExprStillValid
fun:ExecEvalExpr
fun:exec_eval_simple_expr
fun:exec_eval_expr
fun:exec_stmt_raise
fun:exec_stmt
fun:exec_stmts
fun:exec_stmt_block
fun:plpgsql_exec_function
fun:plpgsql_inline_handler
fun:OidFunctionCall1Coll
fun:ExecuteDoStmt
fun:standard_ProcessUtility
fun:ProcessUtility
fun:PortalRunUtility
fun:PortalRunMulti
fun:PortalRun
fun:exec_simple_query
fun:PostgresMain
}
==5718==
==5718== Process terminating with default action of signal 11 (SIGSEGV)
==5718== Access not within mapped region at address 0x20
==5718== at 0x40E3DD: ExecInterpExpr (execExprInterp.c:1117)
==5718== by 0x40F5E9: ExecInterpExprStillValid (execExprInterp.c:1788)
==5718== by 0xE6B0409: ExecEvalExpr (executor.h:282)
==5718== by 0xE6BA6EA: exec_eval_simple_expr (pl_exec.c:5602)
==5718== by 0xE6B9DBB: exec_eval_expr (pl_exec.c:5197)
==5718== by 0xE6B5A4B: exec_stmt_raise (pl_exec.c:3230)
==5718== by 0xE6B2C04: exec_stmt (pl_exec.c:1632)
==5718== by 0xE6B2956: exec_stmts (pl_exec.c:1535)
==5718== by 0xE6B27FC: exec_stmt_block (pl_exec.c:1473)
==5718== by 0xE6B083E: plpgsql_exec_function (pl_exec.c:474)
==5718== by 0xE6AB13C: plpgsql_inline_handler (pl_handler.c:330)
==5718== by 0x76C2B9: OidFunctionCall1Coll (fmgr.c:1327)
==5718== by 0x3A28CA: ExecuteDoStmt (functioncmds.c:2234)
==5718== by 0x5F92EB: standard_ProcessUtility (utility.c:532)
==5718== by 0x5F8E26: ProcessUtility (utility.c:357)
==5718== by 0x5F7D9F: PortalRunUtility (pquery.c:1178)
==5718== by 0x5F7FC0: PortalRunMulti (pquery.c:1324)
==5718== by 0x5F74DE: PortalRun (pquery.c:799)
==5718== by 0x5F10BE: exec_simple_query (postgres.c:1120)
==5718== by 0x5F5640: PostgresMain (postgres.c:4143)
==5718== If you believe this happened as a result of a stack
==5718== overflow in your program's main thread (unlikely but
==5718== possible), you can try to increase the size of the
==5718== main thread stack using the --main-stacksize= flag.
==5718== The main thread stack size used in this run was 8388608.
This looks like it might be related to recent plpgsql changes. Looks
like some pointer in:
/* call input function (similar to InputFunctionCall) */
if (!op->d.iocoerce.finfo_in->fn_strict || str != NULL)
is NULL.
==4286== Conditional jump or move depends on uninitialised value(s)
==4286== at 0x6BA8A17: __wcsnlen_avx2 (strlen-avx2.S:261)
==4286== by 0x6AF2FF1: wcsrtombs (wcsrtombs.c:104)
==4286== by 0x6A88A40: wcstombs (wcstombs.c:34)
==4286== by 0x514772: lowerstr_with_len.part.1 (ts_locale.c:284)
==4286== by 0x523A63: readstoplist (ts_utils.c:119)
==4286== by 0xEAB2839: dsnowball_init (dict_snowball.c:201)
==4286== by 0x684975: OidFunctionCall1Coll (fmgr.c:1327)
==4286== by 0x679277: lookup_ts_dictionary_cache (ts_cache.c:337)
==4286== by 0x514E02: LexizeExec (ts_parse.c:203)
==4286== by 0x5153ED: parsetext (ts_parse.c:405)
==4286== by 0x521DD2: to_tsvector_byid (to_tsany.c:249)
==4286== by 0x380261: ExecInterpExpr (execExprInterp.c:664)
==4286== by 0x456069: ExecEvalExprSwitchContext (executor.h:301)
==4286== by 0x456069: evaluate_expr (clauses.c:4873)
==4286== by 0x4588B5: evaluate_function (clauses.c:4424)
==4286== by 0x4588B5: simplify_function (clauses.c:4064)
==4286== by 0x457519: eval_const_expressions_mutator (clauses.c:2676)
==4286== by 0x3D615A: expression_tree_mutator (nodeFuncs.c:2903)
==4286== by 0x458E43: simplify_function (clauses.c:4055)
==4286== by 0x457519: eval_const_expressions_mutator (clauses.c:2676)
==4286== by 0x3D5C02: expression_tree_mutator (nodeFuncs.c:2614)
==4286== by 0x4572C1: eval_const_expressions_mutator (clauses.c:3671)
==4286== Uninitialised value was created by a heap allocation
==4286== at 0x4C2BB76: malloc (vg_replace_malloc.c:299)
==4286== by 0x6A9667: AllocSetAlloc (aset.c:945)
==4286== by 0x6B5AC7: palloc (mcxt.c:848)
==4286== by 0x5238EA: get_tsearch_config_filename (ts_utils.c:55)
==4286== by 0x5239AF: readstoplist (ts_utils.c:75)
==4286== by 0xEAB2839: dsnowball_init (dict_snowball.c:201)
==4286== by 0x684975: OidFunctionCall1Coll (fmgr.c:1327)
==4286== by 0x679277: lookup_ts_dictionary_cache (ts_cache.c:337)
==4286== by 0x514E02: LexizeExec (ts_parse.c:203)
==4286== by 0x5153ED: parsetext (ts_parse.c:405)
==4286== by 0x521DD2: to_tsvector_byid (to_tsany.c:249)
==4286== by 0x380261: ExecInterpExpr (execExprInterp.c:664)
==4286== by 0x456069: ExecEvalExprSwitchContext (executor.h:301)
==4286== by 0x456069: evaluate_expr (clauses.c:4873)
==4286== by 0x4588B5: evaluate_function (clauses.c:4424)
==4286== by 0x4588B5: simplify_function (clauses.c:4064)
==4286== by 0x457519: eval_const_expressions_mutator (clauses.c:2676)
==4286== by 0x3D615A: expression_tree_mutator (nodeFuncs.c:2903)
==4286== by 0x458E43: simplify_function (clauses.c:4055)
==4286== by 0x457519: eval_const_expressions_mutator (clauses.c:2676)
==4286== by 0x3D5C02: expression_tree_mutator (nodeFuncs.c:2614)
==4286== by 0x4572C1: eval_const_expressions_mutator (clauses.c:3671)
==4286==
{
<insert_a_suppression_name_here>
Memcheck:Cond
fun:__wcsnlen_avx2
fun:wcsrtombs
fun:wcstombs
fun:lowerstr_with_len.part.1
fun:readstoplist
fun:dsnowball_init
fun:OidFunctionCall1Coll
fun:lookup_ts_dictionary_cache
fun:LexizeExec
fun:parsetext
fun:to_tsvector_byid
fun:ExecInterpExpr
fun:ExecEvalExprSwitchContext
fun:evaluate_expr
fun:evaluate_function
fun:simplify_function
fun:eval_const_expressions_mutator
fun:expression_tree_mutator
fun:simplify_function
fun:eval_const_expressions_mutator
fun:expression_tree_mutator
fun:eval_const_expressions_mutator
}
I don't recall any recent changes in the area, so this might be a glibc
internal issue.
Greetings,
Andres Freund
Andres Freund <andres@anarazel.de> writes:
> On 2018-01-04 11:20:33 -0800, Andres Freund wrote:
>> Some packages on skink have been upgraded. It appears that there either
>> was a libc or valgrind change that made valgrind not recognize that a
>> pointer of 0 might not point anywhere :(
> ==5718== Invalid write of size 8
> ==5718== at 0x40E3DD: ExecInterpExpr (execExprInterp.c:1117)
> ==5718== by 0x40F5E9: ExecInterpExprStillValid (execExprInterp.c:1788)
> ==5718== by 0xE6B0409: ExecEvalExpr (executor.h:282)
Are those line numbers supposed to match current HEAD? 1117 does not
contain any write AFAICS:
if (!op->d.iocoerce.finfo_in->fn_strict || str != NULL)
> ==5718== Process terminating with default action of signal 11 (SIGSEGV)
> ==5718== Access not within mapped region at address 0x20
> ==5718== at 0x40E3DD: ExecInterpExpr (execExprInterp.c:1117)
> ==5718== by 0x40F5E9: ExecInterpExprStillValid (execExprInterp.c:1788)
This would be consistent with op->d.iocoerce.finfo_in being NULL, I think,
but there is no way that execExpr.c could have created an EEOP_IOCOERCE
step without filling in the finfo_in pointer.
I think the correct conclusion is that this version of valgrind is
buggy as hell. I wouldn't clutter our code with suppressions trying
to make it sort-of work.
regards, tom lane
On 2018-01-04 15:16:15 -0500, Tom Lane wrote: > Andres Freund <andres@anarazel.de> writes: > > On 2018-01-04 11:20:33 -0800, Andres Freund wrote: > >> Some packages on skink have been upgraded. It appears that there either > >> was a libc or valgrind change that made valgrind not recognize that a > >> pointer of 0 might not point anywhere :( > > > ==5718== Invalid write of size 8 > > ==5718== at 0x40E3DD: ExecInterpExpr (execExprInterp.c:1117) > > ==5718== by 0x40F5E9: ExecInterpExprStillValid (execExprInterp.c:1788) > > ==5718== by 0xE6B0409: ExecEvalExpr (executor.h:282) > > Are those line numbers supposed to match current HEAD? Well, 3e68686e2c55799234ecd020bd1621f913d65475, but that's pretty close. But I think it was just the result of a somehow not entirely clean build, with plpgsql not being rebuilt when necessary. Not sure why/how, but at least that means the epoll_pwait() suppression likely revive skink to some degree. I made sure that the valgrind version isn't affected (from mid last year). After a forced rebuild survives a bit longer, but also encounters ==13750== Conditional jump or move depends on uninitialised value(s) ==13750== at 0x6BA888C: __wcsnlen_avx2 (strlen-avx2.S:103) ==13750== by 0x6AF2FF1: wcsrtombs (wcsrtombs.c:104) ==13750== by 0x6A88A40: wcstombs (wcstombs.c:34) ==13750== by 0x6BA76C: wchar2char (pg_locale.c:1641) ==13750== by 0x653A7C: str_tolower (formatting.c:1591) and various other related issues. I'm not sure if there's a legitimate formatting.c issue or whether it's glibc changes around string handling triggering spurious blurbs. Greetings, Andres Freund
On Mon, Jan 22, 2018 at 6:53 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote: > Here's a possibly more useful graph of regression test timings over > the last year. I pulled this from the buildfarm database: it is the > reported runtime for the "installcheck-C" step in each successful > build of HEAD on dromedary, going back to Jan. 2017. I picked dromedary > because I know that that machine hasn't gotten any software updates > nor is there anything else very interesting going on on it. I dropped > three or four obvious outlier reports (possibly those ran during the > machine's nightly backup cron job). The reported runtime is only > precise to 1s, and a couple seconds jitter is hardly surprising, so > there's a good deal of noise. Still, it's possible to discern when > I put some effort into test runtime reduction back in April, and > it can be seen that things have gotten notably slower since the > beginning of November. Right, but this doesn't seem to show any big spike in the runtime at the time when parallel hash was committed, or when the preparatory patch to add test coverage for hash joins got committed. Rather, there's a gradual increase over time. Either we're making the server slower (which would be bad) or we're adding proper test coverage for all the new features that we're adding (which would be good). We can't expect every feature patch to preserve the runtime of the tests absolutely unchanged; figuring out what can be optimized is a separate exercise from adding test coverage either for new things or for things that weren't previously covered. -- Robert Haas EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company
Robert Haas <robertmhaas@gmail.com> writes:
> On Mon, Jan 22, 2018 at 6:53 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
>> Here's a possibly more useful graph of regression test timings over
>> the last year. I pulled this from the buildfarm database: it is the
>> reported runtime for the "installcheck-C" step in each successful
>> build of HEAD on dromedary, going back to Jan. 2017.
> Right, but this doesn't seem to show any big spike in the runtime at
> the time when parallel hash was committed, or when the preparatory
> patch to add test coverage for hash joins got committed. Rather,
> there's a gradual increase over time.
Well, there's just too much noise in this chart. Let's try another
machine: prairiedog, which is a lot slower so that the 1s resolution
isn't such a limiting factor, and it's also one that I know there hasn't
been much of any system change in.
The first attached PNG shows the "installcheck-C" runtime for as far
back as the buildfarm database has the data, and the second zooms in
on events since late 2016. As before, I've dropped individual outlier
results (those significantly slower than any nearby run) on the grounds
that they probably represent interference from nightly backups. I also
attached the raw data (including outliers) in case anyone wants to do
their own analysis.
There is a very clear secular trend up in the longer data series,
which indicates that we're testing more stuff, which doesn't bother
me in itself as long as the time is well spent. However, the trend
over the last two months is very bad, and I do not think that we can
point to any large improvement in test coverage that someone committed
since November.
Looking more closely at the shorter series, there are four pretty obvious
step changes since 2016-09. The PNG's x-axis doesn't have enough
resolution to match these up to commits, but looking at the underlying
data, they clearly correspond to:
Branch: master Release: REL_10_BR [b801e1200] 2016-10-18 15:57:58 -0400
Improve regression test coverage for hash indexes.
Branch: master Release: REL_10_BR [4a8bc39b0] 2017-04-12 16:17:53 -0400
Speed up hash_index regression test.
Branch: master [fa330f9ad] 2017-11-29 16:06:50 -0800
Add some regression tests that exercise hash join code.
Branch: master [180428404] 2017-12-21 00:43:41 -0800
Add parallel-aware hash joins.
I thought that the hash index test case was excessively expensive for
what it covered, and I'm now thinking the same about hash joins.
regards, tom lane
snapshot | stage_duration
---------------------+----------------
2014-03-19 20:09:45 | 00:03:36
2014-03-20 03:14:59 | 00:03:36
2014-03-20 20:18:16 | 00:03:37
2014-03-21 15:14:58 | 00:03:37
2014-03-22 08:13:01 | 00:03:33
2014-03-23 17:31:09 | 00:03:36
2014-03-24 03:15:41 | 00:03:40
2014-03-24 16:25:33 | 00:03:40
2014-03-25 17:31:06 | 00:03:41
2014-03-26 07:40:27 | 00:03:42
2014-03-26 15:15:26 | 00:03:39
2014-03-28 05:31:19 | 00:03:42
2014-03-28 15:15:16 | 00:03:41
2014-03-29 03:15:25 | 00:03:41
2014-03-29 20:11:03 | 00:03:40
2014-03-30 04:25:56 | 00:03:40
2014-03-31 03:15:13 | 00:03:40
2014-03-31 15:15:26 | 00:03:40
2014-04-01 05:30:55 | 00:03:39
2014-04-01 18:27:27 | 00:03:41
2014-04-02 06:27:47 | 00:03:41
2014-04-03 06:27:32 | 00:03:40
2014-04-03 20:11:41 | 00:03:39
2014-04-04 08:11:19 | 00:03:41
2014-04-04 20:11:51 | 00:03:40
2014-04-05 07:22:58 | 00:03:40
2014-04-06 08:10:55 | 00:03:37
2014-04-07 03:15:40 | 00:03:38
2014-04-07 15:15:37 | 00:03:38
2014-04-08 05:31:15 | 00:03:40
2014-04-08 19:19:25 | 00:03:40
2014-04-09 03:15:51 | 00:03:39
2014-04-09 19:24:29 | 00:03:39
2014-04-10 06:08:41 | 00:03:38
2014-04-10 15:15:44 | 00:03:39
2014-04-11 03:15:42 | 00:03:39
2014-04-13 03:15:38 | 00:03:40
2014-04-13 15:15:48 | 00:03:40
2014-04-14 03:15:38 | 00:03:41
2014-04-14 15:15:49 | 00:03:40
2014-04-15 03:15:43 | 00:03:41
2014-04-15 15:15:39 | 00:03:42
2014-04-16 03:15:48 | 00:03:42
2014-04-16 20:11:45 | 00:03:41
2014-04-17 07:06:24 | 00:03:42
2014-04-17 16:25:58 | 00:03:42
2014-04-18 08:11:54 | 00:03:41
2014-04-18 15:15:40 | 00:03:41
2014-04-19 15:15:44 | 00:03:41
2014-04-20 03:15:38 | 00:03:41
2014-04-20 15:15:44 | 00:03:41
2014-04-22 05:31:27 | 00:03:42
2014-04-22 15:15:49 | 00:03:41
2014-04-23 03:15:41 | 00:03:40
2014-04-23 18:28:37 | 00:03:40
2014-04-24 06:28:45 | 00:03:39
2014-04-24 15:15:44 | 00:03:41
2014-04-25 08:12:47 | 00:03:42
2014-04-26 03:15:44 | 00:03:42
2014-04-27 16:26:23 | 00:03:41
2014-04-28 04:26:14 | 00:03:42
2014-04-28 20:13:16 | 00:03:41
2014-04-29 15:15:50 | 00:03:41
2014-04-30 05:32:21 | 00:03:43
2014-04-30 20:13:44 | 00:03:42
2014-05-01 05:57:23 | 00:03:40
2014-05-02 08:13:47 | 00:03:43
2014-05-04 15:15:53 | 00:03:44
2014-05-05 15:16:21 | 00:03:44
2014-05-06 08:13:57 | 00:03:42
2014-05-06 19:23:42 | 00:03:43
2014-05-07 08:14:54 | 00:03:43
2014-05-08 08:12:04 | 00:03:40
2014-05-08 20:12:25 | 00:03:41
2014-05-09 08:12:28 | 00:03:40
2014-05-09 15:15:53 | 00:03:42
2014-05-10 05:31:45 | 00:03:42
2014-05-10 20:13:01 | 00:03:44
2014-05-11 03:16:22 | 00:03:44
2014-05-12 03:15:49 | 00:03:41
2014-05-12 17:31:51 | 00:03:43
2014-05-13 07:20:25 | 00:03:42
2014-05-13 20:13:24 | 00:03:44
2014-05-14 15:15:53 | 00:03:43
2014-05-15 08:13:15 | 00:03:42
2014-05-15 20:14:09 | 00:03:41
2014-05-16 08:13:40 | 00:03:43
2014-05-16 19:20:43 | 00:03:43
2014-05-17 03:17:06 | 00:03:43
2014-05-17 15:15:54 | 00:03:41
2014-05-18 03:15:57 | 00:03:44
2014-05-19 03:15:44 | 00:03:43
2014-05-19 19:21:20 | 00:03:43
2014-05-20 03:15:56 | 00:03:44
2014-05-21 05:32:18 | 00:03:45
2014-05-21 15:15:55 | 00:03:44
2014-05-22 03:15:58 | 00:03:43
2014-05-22 15:16:01 | 00:03:43
2014-05-23 15:15:57 | 00:03:42
2014-05-24 03:15:55 | 00:03:43
2014-05-25 03:15:47 | 00:03:43
2014-05-26 03:15:49 | 00:03:44
2014-05-26 15:16:03 | 00:03:43
2014-05-27 07:21:02 | 00:03:43
2014-05-28 03:16:03 | 00:03:44
2014-05-28 18:29:32 | 00:03:43
2014-05-29 08:18:40 | 00:03:45
2014-05-30 08:13:52 | 00:03:43
2014-05-31 08:45:58 | 00:03:44
2014-05-31 15:16:06 | 00:03:45
2014-06-01 23:16:20 | 00:03:43
2014-06-02 21:15:56 | 00:03:43
2014-06-03 11:16:00 | 00:03:43
2014-06-03 15:08:22 | 00:03:44
2014-06-03 18:06:43 | 00:03:43
2014-06-03 21:16:05 | 00:03:43
2014-06-03 23:16:01 | 00:03:43
2014-06-04 03:16:21 | 00:03:42
2014-06-04 04:16:11 | 00:03:42
2014-06-04 17:56:17 | 00:03:44
2014-06-05 02:16:18 | 00:03:45
2014-06-05 10:16:06 | 00:03:44
2014-06-05 12:16:15 | 00:03:43
2014-06-05 15:16:11 | 00:03:43
2014-06-05 19:04:12 | 00:03:42
2014-06-09 20:58:12 | 00:03:44
2014-06-10 03:35:25 | 00:03:44
2014-06-11 02:17:14 | 00:03:43
2014-06-11 07:01:25 | 00:03:45
2014-06-11 12:17:07 | 00:03:44
2014-06-12 12:16:32 | 00:03:45
2014-06-13 01:00:17 | 00:03:45
2014-06-14 01:03:18 | 00:03:44
2014-06-14 08:18:04 | 00:03:44
2014-06-14 20:55:43 | 00:03:44
2014-06-16 21:04:07 | 00:03:44
2014-06-17 06:16:28 | 00:03:44
2014-06-17 17:04:08 | 00:03:47
2014-06-18 15:03:52 | 00:03:44
2014-06-18 18:17:08 | 00:03:43
2014-06-18 21:39:38 | 00:03:45
2014-06-19 01:01:18 | 00:03:44
2014-06-19 13:09:10 | 00:03:44
2014-06-19 15:04:17 | 00:03:44
2014-06-19 18:00:59 | 00:03:44
2014-06-20 06:43:04 | 00:03:44
2014-06-20 11:40:28 | 00:03:38
2014-06-20 22:18:26 | 00:03:36
2014-06-20 23:16:28 | 00:03:38
2014-06-21 17:47:29 | 00:03:39
2014-06-21 21:01:31 | 00:03:38
2014-06-23 10:16:43 | 00:03:37
2014-06-23 20:01:53 | 00:03:38
2014-06-23 21:17:12 | 00:03:36
2014-06-24 02:17:10 | 00:03:38
2014-06-24 13:53:03 | 00:03:37
2014-06-24 21:41:38 | 00:03:38
2014-06-25 06:41:45 | 00:03:38
2014-06-25 20:01:43 | 00:03:36
2014-06-26 00:01:52 | 00:03:39
2014-06-26 09:42:13 | 00:03:39
2014-06-26 20:47:31 | 00:03:41
2014-06-27 01:07:10 | 00:03:35
2014-06-27 19:02:25 | 00:03:36
2014-06-28 06:17:15 | 00:03:39
2014-06-28 20:17:04 | 00:03:36
2014-06-29 13:17:02 | 00:03:38
2014-06-29 19:04:14 | 00:03:38
2014-06-30 09:02:04 | 00:03:38
2014-06-30 23:19:51 | 00:03:38
2014-07-01 01:01:45 | 00:03:39
2014-07-01 02:17:13 | 00:03:37
2014-07-01 15:17:02 | 00:03:37
2014-07-01 19:13:39 | 00:03:36
2014-07-01 22:17:09 | 00:03:36
2014-07-01 23:17:18 | 00:03:37
2014-07-02 00:17:20 | 00:03:37
2014-07-02 05:02:32 | 00:03:37
2014-07-02 18:42:21 | 00:03:36
2014-07-02 23:46:47 | 00:03:38
2014-07-03 03:02:49 | 00:03:38
2014-07-03 20:17:33 | 00:03:38
2014-07-04 00:29:18 | 00:03:36
2014-07-04 03:17:03 | 00:03:38
2014-07-04 04:17:08 | 00:03:38
2014-07-04 11:17:24 | 00:03:38
2014-07-05 16:17:26 | 00:03:38
2014-07-06 06:02:39 | 00:03:38
2014-07-06 15:03:30 | 00:03:37
2014-07-06 19:16:55 | 00:03:38
2014-07-07 11:17:00 | 00:03:38
2014-07-07 20:19:24 | 00:03:37
2014-07-07 23:17:27 | 00:03:38
2014-07-08 02:16:58 | 00:03:38
2014-07-08 17:02:32 | 00:03:37
2014-07-08 21:44:37 | 00:03:38
2014-07-09 05:02:54 | 00:03:38
2014-07-09 15:17:30 | 00:03:36
2014-07-09 16:17:08 | 00:03:35
2014-07-10 06:17:06 | 00:03:36
2014-07-10 18:17:48 | 00:03:36
2014-07-10 19:18:07 | 00:03:39
2014-07-11 19:17:35 | 00:03:38
2014-07-12 02:45:13 | 00:03:34
2014-07-12 16:46:50 | 00:03:39
2014-07-12 18:17:20 | 00:03:34
2014-07-14 11:17:09 | 00:03:37
2014-07-14 13:03:56 | 00:03:37
2014-07-14 19:17:14 | 00:03:38
2014-07-14 23:14:49 | 00:03:37
2014-07-15 04:43:53 | 00:03:37
2014-07-15 17:40:31 | 00:03:37
2014-07-15 22:59:01 | 00:03:34
2014-07-16 01:17:13 | 00:03:38
2014-07-16 08:43:32 | 00:03:38
2014-07-17 04:03:49 | 00:03:38
2014-07-17 11:16:47 | 00:03:36
2014-07-17 12:16:58 | 00:03:39
2014-07-18 20:45:37 | 00:03:40
2014-07-19 22:45:43 | 00:03:41
2014-07-20 05:48:17 | 00:03:40
2014-07-20 23:16:48 | 00:03:38
2014-07-21 02:16:55 | 00:03:38
2014-07-21 06:06:05 | 00:03:39
2014-07-21 11:16:38 | 00:03:38
2014-07-21 17:42:15 | 00:03:37
2014-07-21 22:55:41 | 00:03:38
2014-07-22 06:16:49 | 00:03:38
2014-07-22 18:17:09 | 00:03:38
2014-07-23 08:15:28 | 00:03:38
2014-07-23 23:15:17 | 00:03:37
2014-07-24 04:02:56 | 00:03:38
2014-07-24 07:17:21 | 00:03:36
2014-07-24 12:18:01 | 00:03:38
2014-07-24 15:21:02 | 00:03:38
2014-07-25 23:17:05 | 00:03:37
2014-07-26 02:50:58 | 00:03:38
2014-07-27 05:03:00 | 00:03:38
2014-07-28 22:02:35 | 00:03:38
2014-07-29 05:02:22 | 00:03:37
2014-07-29 12:57:29 | 00:03:37
2014-07-29 16:02:38 | 00:03:39
2014-07-29 20:17:08 | 00:03:39
2014-07-30 02:17:40 | 00:03:38
2014-07-30 05:02:29 | 00:03:37
2014-07-30 18:43:09 | 00:03:38
2014-07-31 14:17:44 | 00:03:39
2014-08-01 22:15:12 | 00:03:38
2014-08-02 07:52:40 | 00:03:38
2014-08-04 15:17:26 | 00:03:38
2014-08-04 17:42:53 | 00:03:38
2014-08-06 16:16:47 | 00:03:38
2014-08-06 20:18:01 | 00:03:37
2014-08-07 10:17:03 | 00:03:38
2014-08-07 20:43:40 | 00:03:39
2014-08-08 02:02:26 | 00:03:38
2014-08-08 08:17:57 | 00:03:37
2014-08-09 06:03:57 | 00:03:37
2014-08-09 21:18:27 | 00:03:38
2014-08-09 23:02:53 | 00:03:36
2014-08-10 23:16:13 | 00:03:36
2014-08-11 09:18:28 | 00:03:38
2014-08-11 16:50:33 | 00:03:39
2014-08-12 04:17:12 | 00:03:37
2014-08-12 09:03:45 | 00:03:38
2014-08-12 11:02:57 | 00:04:44
2014-08-12 13:03:02 | 00:03:37
2014-08-13 03:03:40 | 00:03:39
2014-08-13 16:18:43 | 00:03:37
2014-08-14 02:18:19 | 00:03:37
2014-08-14 04:18:47 | 00:03:38
2014-08-14 07:44:11 | 00:03:40
2014-08-14 16:18:50 | 00:03:38
2014-08-14 23:16:44 | 00:03:38
2014-08-15 02:18:25 | 00:03:38
2014-08-15 05:03:30 | 00:03:38
2014-08-15 07:18:51 | 00:03:38
2014-08-15 16:18:50 | 00:03:38
2014-08-15 17:18:33 | 00:03:40
2014-08-15 19:03:14 | 00:03:39
2014-08-16 18:06:12 | 00:03:38
2014-08-17 15:02:52 | 00:03:37
2014-08-17 21:02:34 | 00:03:39
2014-08-18 04:03:10 | 00:03:40
2014-08-18 09:15:24 | 00:03:40
2014-08-18 12:11:54 | 00:03:38
2014-08-18 22:18:19 | 00:03:39
2014-08-19 06:16:56 | 00:03:38
2014-08-19 10:03:56 | 00:03:37
2014-08-20 09:17:34 | 00:03:38
2014-08-20 17:18:26 | 00:03:40
2014-08-20 22:03:02 | 00:03:39
2014-08-21 00:03:44 | 00:03:42
2014-08-21 07:18:36 | 00:03:39
2014-08-22 00:34:33 | 00:03:39
2014-08-22 02:17:28 | 00:03:41
2014-08-22 09:02:59 | 00:03:39
2014-08-22 12:09:51 | 00:03:39
2014-08-22 16:17:26 | 00:03:38
2014-08-22 19:03:28 | 00:03:38
2014-08-23 06:03:10 | 00:03:39
2014-08-24 16:17:00 | 00:03:39
2014-08-25 19:50:22 | 00:03:39
2014-08-25 22:03:34 | 00:03:39
2014-08-26 00:17:46 | 00:03:39
2014-08-26 02:16:57 | 00:03:39
2014-08-26 03:17:02 | 00:03:39
2014-08-26 09:17:08 | 00:03:40
2014-08-26 11:17:17 | 00:03:39
2014-08-26 14:17:21 | 00:03:39
2014-08-26 17:03:33 | 00:03:39
2014-08-26 20:16:50 | 00:03:38
2014-08-26 22:17:04 | 00:03:39
2014-08-27 03:17:11 | 00:03:38
2014-08-27 05:03:06 | 00:03:38
2014-08-27 11:17:08 | 00:03:40
2014-08-28 01:10:23 | 00:03:39
2014-08-28 04:17:47 | 00:03:38
2014-08-28 21:17:05 | 00:03:37
2014-08-29 01:49:03 | 00:03:40
2014-08-29 03:17:29 | 00:03:38
2014-08-29 06:03:47 | 00:03:39
2014-08-29 13:03:05 | 00:03:37
2014-08-29 15:02:58 | 00:03:37
2014-08-29 23:17:56 | 00:03:37
2014-08-30 12:18:12 | 00:03:30
2014-08-30 15:17:13 | 00:03:31
2014-08-30 20:18:19 | 00:03:31
2014-08-31 22:17:24 | 00:03:32
2014-09-01 00:02:44 | 00:03:29
2014-09-01 10:18:02 | 00:03:31
2014-09-01 15:04:03 | 00:03:32
2014-09-01 23:17:07 | 00:03:31
2014-09-02 08:17:25 | 00:03:31
2014-09-02 13:03:48 | 00:03:30
2014-09-03 16:17:24 | 00:03:31
2014-09-03 20:02:56 | 00:03:32
2014-09-03 23:02:46 | 00:03:32
2014-09-04 04:17:26 | 00:03:32
2014-09-04 17:17:25 | 00:03:32
2014-09-04 21:16:43 | 00:03:32
2014-09-05 04:03:34 | 00:03:32
2014-09-05 07:04:05 | 00:03:33
2014-09-05 14:17:22 | 00:03:32
2014-09-06 00:03:13 | 00:03:31
2014-09-06 16:03:53 | 00:03:32
2014-09-06 18:03:03 | 00:03:33
2014-09-07 13:04:31 | 00:03:32
2014-09-08 06:16:28 | 00:03:31
2014-09-08 23:19:48 | 00:03:30
2014-09-09 12:18:23 | 00:03:33
2014-09-09 16:03:19 | 00:03:32
2014-09-09 19:04:14 | 00:03:33
2014-09-09 20:17:46 | 00:03:32
2014-09-10 01:45:42 | 00:03:32
2014-09-10 16:16:56 | 00:03:32
2014-09-10 19:16:58 | 00:03:32
2014-09-10 21:17:14 | 00:03:32
2014-09-11 00:16:58 | 00:03:32
2014-09-11 02:03:06 | 00:03:33
2014-09-11 11:03:29 | 00:05:21
2014-09-11 14:02:53 | 00:03:32
2014-09-11 18:17:05 | 00:03:32
2014-09-11 21:03:14 | 00:03:33
2014-09-12 00:47:00 | 00:03:37
2014-09-12 03:03:08 | 00:03:32
2014-09-12 07:28:31 | 00:03:55
2014-09-12 10:04:44 | 00:03:54
2014-09-12 16:07:24 | 00:03:54
2014-09-12 20:24:37 | 00:03:54
2014-09-13 01:17:30 | 00:03:55
2014-09-13 20:17:31 | 00:03:54
2014-09-14 01:17:31 | 00:03:54
2014-09-14 14:17:28 | 00:03:55
2014-09-15 18:16:18 | 00:03:53
2014-09-16 08:06:40 | 00:03:54
2014-09-17 06:05:55 | 00:03:52
2014-09-18 08:18:25 | 00:03:54
2014-09-19 16:06:21 | 00:03:58
2014-09-19 20:26:48 | 00:03:58
2014-09-22 18:17:52 | 00:03:58
2014-09-22 22:47:14 | 00:03:59
2014-09-23 02:04:29 | 00:03:57
2014-09-24 03:25:42 | 00:03:56
2014-09-24 17:05:42 | 00:03:56
2014-09-24 21:04:54 | 00:03:58
2014-09-24 22:17:45 | 00:03:58
2014-09-25 11:17:31 | 00:03:59
2014-09-25 14:04:44 | 00:03:59
2014-09-25 17:58:10 | 00:04:00
2014-09-25 20:05:55 | 00:04:00
2014-09-26 01:17:41 | 00:04:00
2014-09-26 07:17:20 | 00:03:58
2014-09-26 08:17:15 | 00:03:59
2014-09-26 15:18:17 | 00:03:58
2014-09-26 19:27:54 | 00:03:59
2014-09-29 18:06:11 | 00:03:58
2014-09-30 00:17:15 | 00:03:58
2014-09-30 02:04:55 | 00:03:58
2014-09-30 16:06:06 | 00:03:58
2014-09-30 21:47:44 | 00:04:00
2014-10-01 12:18:09 | 00:03:58
2014-10-01 14:05:20 | 00:03:57
2014-10-01 16:20:35 | 00:04:00
2014-10-02 03:29:08 | 00:04:01
2014-10-02 11:18:11 | 00:03:59
2014-10-02 16:24:26 | 00:03:59
2014-10-02 20:17:19 | 00:04:00
2014-10-03 08:17:18 | 00:03:59
2014-10-03 15:24:51 | 00:03:59
2014-10-03 19:24:43 | 00:04:00
2014-10-03 22:48:17 | 00:03:59
2014-10-04 22:25:17 | 00:03:59
2014-10-05 04:05:38 | 00:03:59
2014-10-05 19:03:35 | 00:04:00
2014-10-06 11:03:50 | 00:07:41
2014-10-06 16:17:40 | 00:04:00
2014-10-07 05:25:40 | 00:04:01
2014-10-07 21:18:05 | 00:04:01
2014-10-08 19:17:25 | 00:03:58
2014-10-08 22:17:31 | 00:03:59
2014-10-09 22:23:32 | 00:03:58
2014-10-10 08:17:41 | 00:03:57
2014-10-10 10:18:30 | 00:03:58
2014-10-11 19:06:18 | 00:03:59
2014-10-11 21:16:42 | 00:03:59
2014-10-11 22:17:35 | 00:03:57
2014-10-11 23:17:33 | 00:03:59
2014-10-12 07:06:13 | 00:03:58
2014-10-13 07:24:10 | 00:03:58
2014-10-13 16:17:34 | 00:03:59
2014-10-13 18:17:27 | 00:03:57
2014-10-13 20:17:34 | 00:03:57
2014-10-13 21:17:36 | 00:03:59
2014-10-13 22:17:36 | 00:03:59
2014-10-14 04:05:12 | 00:03:57
2014-10-14 08:05:18 | 00:03:59
2014-10-14 19:18:25 | 00:03:58
2014-10-14 21:17:30 | 00:03:59
2014-10-16 00:06:10 | 00:03:58
2014-10-17 00:53:31 | 00:04:01
2014-10-17 12:18:32 | 00:03:59
2014-10-17 20:28:00 | 00:03:59
2014-10-18 09:25:55 | 00:04:00
2014-10-18 15:05:18 | 00:04:00
2014-10-19 02:17:33 | 00:03:59
2014-10-19 05:05:00 | 00:03:59
2014-10-20 15:17:43 | 00:03:58
2014-10-20 18:47:46 | 00:04:01
2014-10-20 21:05:47 | 00:04:00
2014-10-21 02:06:51 | 00:04:00
2014-10-21 15:17:36 | 00:03:58
2014-10-21 19:17:35 | 00:04:01
2014-10-21 21:17:39 | 00:04:01
2014-10-22 00:05:09 | 00:03:59
2014-10-22 04:05:30 | 00:04:00
2014-10-22 13:18:53 | 00:04:01
2014-10-22 15:17:33 | 00:03:59
2014-10-23 02:26:04 | 00:03:59
2014-10-23 10:27:11 | 00:03:59
2014-10-23 13:17:41 | 00:04:01
2014-10-23 15:17:46 | 00:03:59
2014-10-23 20:24:50 | 00:04:01
2014-10-24 00:17:37 | 00:03:59
2014-10-24 11:17:38 | 00:03:58
2014-10-24 13:18:50 | 00:04:00
2014-10-24 17:17:46 | 00:04:00
2014-10-24 19:57:40 | 00:04:02
2014-10-25 10:17:41 | 00:03:59
2014-10-26 15:05:32 | 00:04:00
2014-10-26 22:27:34 | 00:04:00
2014-10-27 01:05:22 | 00:04:02
2014-10-27 12:37:13 | 00:04:03
2014-10-27 16:06:52 | 00:04:00
2014-10-28 01:06:26 | 00:04:01
2014-10-28 20:05:42 | 00:04:01
2014-10-29 00:05:37 | 00:04:02
2014-10-29 16:24:58 | 00:04:00
2014-10-29 17:17:54 | 00:04:01
2014-10-30 01:26:43 | 00:04:01
2014-10-30 17:07:14 | 00:04:02
2014-10-30 21:29:22 | 00:04:02
2014-10-31 04:05:57 | 00:04:02
2014-10-31 13:04:30 | 00:04:00
2014-10-31 17:19:14 | 00:04:00
2014-11-01 18:29:38 | 00:04:00
2014-11-02 16:06:52 | 00:04:01
2014-11-03 03:05:52 | 00:04:01
2014-11-03 19:28:47 | 00:04:00
2014-11-04 10:18:26 | 00:04:00
2014-11-04 22:27:11 | 00:04:03
2014-11-05 19:57:38 | 00:03:59
2014-11-06 00:17:58 | 00:04:02
2014-11-06 01:18:02 | 00:03:59
2014-11-06 08:18:58 | 00:04:02
2014-11-06 10:18:32 | 00:04:03
2014-11-06 12:18:18 | 00:04:01
2014-11-06 17:26:13 | 00:04:02
2014-11-07 05:25:12 | 00:04:03
2014-11-07 13:19:18 | 00:04:00
2014-11-07 21:05:56 | 00:05:01
2014-11-07 23:18:19 | 00:05:00
2014-11-08 03:05:29 | 00:04:59
2014-11-08 04:17:53 | 00:05:01
2014-11-10 02:18:01 | 00:04:58
2014-11-10 14:17:48 | 00:04:59
2014-11-10 16:17:51 | 00:05:01
2014-11-10 19:19:18 | 00:04:59
2014-11-11 00:03:15 | 00:05:00
2014-11-11 09:17:47 | 00:04:58
2014-11-11 12:19:41 | 00:05:02
2014-11-11 14:18:04 | 00:05:03
2014-11-12 01:01:53 | 00:04:59
2014-11-12 04:05:51 | 00:05:00
2014-11-12 14:05:52 | 00:04:59
2014-11-12 23:28:16 | 00:05:02
2014-11-13 03:16:13 | 00:04:59
2014-11-13 16:17:47 | 00:05:00
2014-11-13 18:05:38 | 00:05:00
2014-11-13 22:58:58 | 00:04:59
2014-11-14 02:59:56 | 00:05:01
2014-11-14 17:17:47 | 00:05:01
2014-11-14 20:48:44 | 00:04:08
2014-11-14 23:07:19 | 00:04:06
2014-11-15 01:05:37 | 00:04:05
2014-11-15 05:17:31 | 00:04:07
2014-11-15 23:17:36 | 00:04:06
2014-11-16 16:05:30 | 00:04:06
2014-11-17 04:06:08 | 00:04:07
2014-11-17 15:17:56 | 00:04:06
2014-11-17 20:33:05 | 00:04:06
2014-11-17 23:15:37 | 00:04:06
2014-11-18 08:18:48 | 00:04:05
2014-11-18 11:18:03 | 00:04:07
2014-11-18 20:49:29 | 00:04:05
2014-11-18 22:18:02 | 00:04:06
2014-11-19 06:25:14 | 00:04:05
2014-11-19 11:07:41 | 00:04:06
2014-11-19 20:58:37 | 00:04:26
2014-11-20 01:25:52 | 00:04:28
2014-11-20 04:18:06 | 00:04:27
2014-11-20 17:19:54 | 00:04:29
2014-11-20 19:18:04 | 00:04:32
2014-11-20 21:18:05 | 00:04:28
2014-11-21 00:18:13 | 00:04:31
2014-11-21 02:18:08 | 00:04:27
2014-11-21 10:18:56 | 00:04:27
2014-11-21 13:19:44 | 00:04:27
2014-11-21 18:18:03 | 00:04:27
2014-11-21 19:19:48 | 00:04:28
2014-11-22 00:18:16 | 00:04:27
2014-11-22 15:18:07 | 00:04:29
2014-11-22 23:32:00 | 00:04:29
2014-11-23 01:18:09 | 00:04:28
2014-11-23 15:18:11 | 00:04:29
2014-11-23 19:18:06 | 00:04:27
2014-11-23 21:18:05 | 00:04:28
2014-11-24 09:19:46 | 00:04:27
2014-11-24 12:18:11 | 00:04:29
2014-11-24 23:18:17 | 00:04:30
2014-11-25 08:18:41 | 00:04:29
2014-11-25 17:30:58 | 00:04:28
2014-11-25 20:58:26 | 00:04:30
2014-11-26 01:19:35 | 00:04:31
2014-11-26 04:18:00 | 00:04:29
2014-11-26 09:19:38 | 00:04:25
2014-11-27 07:19:10 | 00:04:28
2014-11-27 19:31:27 | 00:04:28
2014-11-28 08:18:49 | 00:04:27
2014-11-28 14:06:51 | 00:04:27
2014-11-28 18:18:16 | 00:04:29
2014-11-28 19:19:26 | 00:04:27
2014-11-28 22:50:24 | 00:04:29
2014-11-29 19:11:24 | 00:04:28
2014-11-29 22:06:19 | 00:04:27
2014-11-30 03:20:09 | 00:04:28
2014-11-30 21:27:21 | 00:04:30
2014-12-01 01:18:15 | 00:04:29
2014-12-01 13:01:18 | 00:04:26
2014-12-01 16:18:19 | 00:04:32
2014-12-01 18:13:17 | 00:04:31
2014-12-01 20:02:30 | 00:04:32
2014-12-02 00:27:50 | 00:04:31
2014-12-02 14:16:30 | 00:04:29
2014-12-02 16:18:26 | 00:04:28
2014-12-02 19:20:06 | 00:04:29
2014-12-02 21:51:28 | 00:04:30
2014-12-03 00:08:44 | 00:04:25
2014-12-03 03:18:27 | 00:04:28
2014-12-03 05:18:24 | 00:04:25
2014-12-03 16:08:19 | 00:04:29
2014-12-03 20:18:24 | 00:04:26
2014-12-04 03:20:28 | 00:04:28
2014-12-04 18:07:02 | 00:04:28
2014-12-05 00:06:38 | 00:04:28
2014-12-05 01:18:33 | 00:04:31
2014-12-05 11:06:45 | 00:04:28
2014-12-05 12:18:30 | 00:04:28
2014-12-05 17:28:06 | 00:04:30
2014-12-07 13:18:34 | 00:04:26
2014-12-07 16:18:48 | 00:04:28
2014-12-08 00:18:27 | 00:04:28
2014-12-08 01:18:32 | 00:04:31
2014-12-08 08:19:21 | 00:04:31
2014-12-08 15:18:34 | 00:04:30
2014-12-08 17:18:56 | 00:04:34
2014-12-09 09:20:17 | 00:04:29
2014-12-09 13:18:49 | 00:04:29
2014-12-09 16:18:46 | 00:04:29
2014-12-11 01:08:33 | 00:04:29
2014-12-11 03:06:47 | 00:04:27
2014-12-11 09:18:31 | 00:04:28
2014-12-11 22:51:09 | 00:04:29
2014-12-12 00:18:49 | 00:04:29
2014-12-12 04:28:55 | 00:04:27
2014-12-12 13:18:34 | 00:04:29
2014-12-12 14:20:34 | 00:04:28
2014-12-12 19:49:21 | 00:04:29
2014-12-12 21:18:55 | 00:04:31
2014-12-13 18:06:56 | 00:04:28
2014-12-13 20:07:58 | 00:04:30
2014-12-14 21:06:54 | 00:04:29
2014-12-15 00:08:30 | 00:04:29
2014-12-15 02:08:39 | 00:04:31
2014-12-15 07:06:48 | 00:04:32
2014-12-15 19:20:01 | 00:04:30
2014-12-15 21:06:39 | 00:04:27
2014-12-15 23:06:31 | 00:04:28
2014-12-16 02:15:44 | 00:04:26
2014-12-16 13:58:25 | 00:04:28
2014-12-16 16:50:47 | 00:04:28
2014-12-16 21:52:28 | 00:04:28
2014-12-17 10:08:27 | 00:04:30
2014-12-17 13:40:57 | 00:04:31
2014-12-17 18:16:38 | 00:04:29
2014-12-17 21:29:44 | 00:04:29
2014-12-17 22:38:56 | 00:04:27
2014-12-18 07:09:37 | 00:04:28
2014-12-18 10:29:48 | 00:04:27
2014-12-18 14:15:20 | 00:04:29
2014-12-18 18:39:47 | 00:04:29
2014-12-18 20:38:36 | 00:04:30
2014-12-18 21:38:35 | 00:04:31
2014-12-19 01:48:24 | 00:04:30
2014-12-19 13:38:38 | 00:04:32
2014-12-19 18:10:00 | 00:04:29
2014-12-20 02:18:39 | 00:04:28
2014-12-21 20:18:39 | 00:04:28
2014-12-22 00:28:44 | 00:04:27
2014-12-22 10:20:38 | 00:04:32
2014-12-22 15:59:40 | 00:04:32
2014-12-22 21:09:55 | 00:04:31
2014-12-23 01:13:56 | 00:04:31
2014-12-23 04:20:38 | 00:04:29
2014-12-23 12:21:02 | 00:04:28
2014-12-23 13:59:30 | 00:04:29
2014-12-23 21:56:44 | 00:04:29
2014-12-24 11:43:38 | 00:04:33
2014-12-24 12:58:54 | 00:04:39
2014-12-24 14:38:42 | 00:04:30
2014-12-24 16:32:08 | 00:04:32
2014-12-25 01:10:49 | 00:04:36
2014-12-25 18:39:00 | 00:04:33
2014-12-25 23:29:57 | 00:04:33
2014-12-26 18:31:27 | 00:04:38
2014-12-28 17:20:37 | 00:04:33
2014-12-29 22:48:49 | 00:04:38
2014-12-30 15:22:23 | 00:04:41
2014-12-30 18:20:45 | 00:04:38
2014-12-30 19:19:10 | 00:04:38
2014-12-30 20:58:56 | 00:04:41
2014-12-31 16:20:44 | 00:04:39
2014-12-31 17:18:48 | 00:04:38
2014-12-31 21:35:14 | 00:04:37
2015-01-01 01:49:36 | 00:04:39
2015-01-03 15:59:46 | 00:04:37
2015-01-03 19:06:07 | 00:04:36
2015-01-03 23:41:49 | 00:04:42
2015-01-04 16:10:40 | 00:04:38
2015-01-04 20:29:18 | 00:04:36
2015-01-05 07:58:58 | 00:04:37
2015-01-05 12:00:17 | 00:08:11
2015-01-06 02:11:30 | 00:04:38
2015-01-06 20:17:24 | 00:04:37
2015-01-06 22:57:01 | 00:04:40
2015-01-07 03:09:20 | 00:04:38
2015-01-07 04:17:30 | 00:04:38
2015-01-07 14:38:00 | 00:04:40
2015-01-07 20:02:44 | 00:04:41
2015-01-08 08:00:53 | 00:04:37
2015-01-08 13:41:41 | 00:04:43
2015-01-08 19:37:48 | 00:04:37
2015-01-09 17:29:57 | 00:04:38
2015-01-10 00:37:52 | 00:04:37
2015-01-11 00:37:59 | 00:04:35
2015-01-11 17:36:46 | 00:04:41
2015-01-11 19:58:03 | 00:04:41
2015-01-12 20:54:14 | 00:04:37
2015-01-13 01:09:40 | 00:04:33
2015-01-13 08:41:11 | 00:04:42
2015-01-13 12:20:07 | 00:04:44
2015-01-13 13:38:59 | 00:04:38
2015-01-13 17:58:53 | 00:04:37
2015-01-14 02:44:43 | 00:04:40
2015-01-14 04:03:10 | 00:04:40
2015-01-14 17:48:05 | 00:04:38
2015-01-14 19:38:39 | 00:04:37
2015-01-14 20:58:15 | 00:04:39
2015-01-14 21:58:15 | 00:04:38
2015-01-15 12:53:46 | 00:04:38
2015-01-15 18:12:04 | 00:04:40
2015-01-15 21:19:44 | 00:04:41
2015-01-16 02:12:09 | 00:04:38
2015-01-16 09:50:41 | 00:04:38
2015-01-16 14:04:29 | 00:04:40
2015-01-16 17:03:17 | 00:04:41
2015-01-16 18:38:20 | 00:04:37
2015-01-16 23:38:36 | 00:04:39
2015-01-17 12:20:29 | 00:04:41
2015-01-18 17:51:07 | 00:04:41
2015-01-18 19:20:32 | 00:04:39
2015-01-18 22:20:34 | 00:04:40
2015-01-19 03:58:35 | 00:04:40
2015-01-19 13:58:29 | 00:04:39
2015-01-19 16:51:50 | 00:04:40
2015-01-19 20:38:44 | 00:04:39
2015-01-19 23:58:36 | 00:04:40
2015-01-20 07:33:20 | 00:04:38
2015-01-20 15:59:13 | 00:04:38
2015-01-20 18:20:41 | 00:04:38
2015-01-21 01:39:14 | 00:04:42
2015-01-22 15:38:33 | 00:04:38
2015-01-22 16:38:39 | 00:04:39
2015-01-22 17:38:33 | 00:04:36
2015-01-22 18:38:46 | 00:04:38
2015-01-22 20:20:50 | 00:04:35
2015-01-22 22:18:31 | 00:04:38
2015-01-22 23:20:54 | 00:04:39
2015-01-23 17:03:39 | 00:04:39
2015-01-23 18:18:45 | 00:04:39
2015-01-23 20:20:51 | 00:04:38
2015-01-24 14:38:35 | 00:04:37
2015-01-24 17:17:00 | 00:04:37
2015-01-24 21:32:50 | 00:04:38
2015-01-26 02:27:38 | 00:04:39
2015-01-26 04:51:41 | 00:04:39
2015-01-26 20:30:41 | 00:04:38
2015-01-27 00:18:36 | 00:04:37
2015-01-27 20:04:43 | 00:04:38
2015-01-28 08:21:46 | 00:04:40
2015-01-28 09:18:47 | 00:04:39
2015-01-28 19:13:16 | 00:04:36
2015-01-29 01:41:07 | 00:04:42
2015-01-29 03:03:51 | 00:04:39
2015-01-29 04:18:40 | 00:04:37
2015-01-29 05:19:52 | 00:04:38
2015-01-29 15:38:41 | 00:04:39
2015-01-29 20:44:40 | 00:04:43
2015-01-30 01:50:12 | 00:04:40
2015-01-30 06:51:03 | 00:04:40
2015-01-30 16:54:05 | 00:04:41
2015-01-30 19:33:41 | 00:04:40
2015-01-31 00:30:11 | 00:04:38
2015-01-31 07:12:53 | 00:04:39
2015-01-31 22:44:51 | 00:04:37
2015-02-01 03:10:22 | 00:04:39
2015-02-01 21:57:07 | 00:04:39
2015-02-02 06:53:07 | 00:04:39
2015-02-02 19:32:29 | 00:04:38
2015-02-03 01:10:52 | 00:04:42
2015-02-03 07:58:31 | 00:04:37
2015-02-03 08:58:31 | 00:04:37
2015-02-03 12:20:50 | 00:04:42
2015-02-03 18:18:36 | 00:04:38
2015-02-03 21:26:46 | 00:04:37
2015-02-03 22:38:42 | 00:04:37
2015-02-03 23:58:26 | 00:04:38
2015-02-04 07:20:46 | 00:04:37
2015-02-04 11:09:23 | 00:04:37
2015-02-04 15:42:14 | 00:04:37
2015-02-05 14:20:25 | 00:04:37
2015-02-06 12:23:52 | 00:04:36
2015-02-07 05:03:13 | 00:04:38
2015-02-09 06:17:07 | 00:04:36
2015-02-09 09:38:54 | 00:04:36
2015-02-09 19:05:13 | 00:04:37
2015-02-09 20:38:45 | 00:04:37
2015-02-10 09:21:20 | 00:04:37
2015-02-10 11:21:16 | 00:04:35
2015-02-11 05:18:46 | 00:04:36
2015-02-12 00:27:54 | 00:04:36
2015-02-12 03:51:02 | 00:04:36
2015-02-13 20:03:33 | 00:04:38
2015-02-14 01:32:16 | 00:04:37
2015-02-14 17:39:03 | 00:04:37
2015-02-15 02:37:15 | 00:04:35
2015-02-15 22:21:30 | 00:04:35
2015-02-16 06:49:57 | 00:04:37
2015-02-16 17:39:19 | 00:04:38
2015-02-16 20:21:50 | 00:04:38
2015-02-16 21:19:21 | 00:04:41
2015-02-17 01:29:49 | 00:04:37
2015-02-17 17:32:41 | 00:04:38
2015-02-17 21:52:56 | 00:04:38
2015-02-18 00:20:10 | 00:04:37
2015-02-18 19:43:05 | 00:04:40
2015-02-19 01:39:06 | 00:04:37
2015-02-19 02:39:19 | 00:04:39
2015-02-19 03:59:07 | 00:04:37
2015-02-19 19:39:10 | 00:04:38
2015-02-20 02:37:14 | 00:04:41
2015-02-20 05:22:20 | 00:04:40
2015-02-20 06:59:16 | 00:04:39
2015-02-20 07:59:06 | 00:04:39
2015-02-20 15:21:46 | 00:04:43
2015-02-20 16:39:07 | 00:04:38
2015-02-20 17:39:08 | 00:04:39
2015-02-20 22:03:54 | 00:04:41
2015-02-20 23:59:38 | 00:04:38
2015-02-21 07:03:59 | 00:04:38
2015-02-21 17:39:10 | 00:04:36
2015-02-21 21:31:06 | 00:04:38
2015-02-21 23:00:09 | 00:04:39
2015-02-22 01:45:48 | 00:04:41
2015-02-22 07:39:07 | 00:04:38
2015-02-22 19:19:28 | 00:04:40
2015-02-22 20:59:29 | 00:04:39
2015-02-23 15:34:04 | 00:04:40
2015-02-23 20:10:24 | 00:04:38
2015-02-23 22:19:00 | 00:04:40
2015-02-24 12:54:02 | 00:04:41
2015-02-24 18:59:05 | 00:04:38
2015-02-24 23:02:05 | 00:04:40
2015-02-25 11:17:10 | 00:04:39
2015-02-25 20:35:44 | 00:04:36
2015-02-26 02:37:16 | 00:04:37
2015-02-26 04:37:17 | 00:04:38
2015-02-26 08:51:59 | 00:04:38
2015-02-26 16:34:10 | 00:04:39
2015-02-26 18:28:08 | 00:04:40
2015-02-27 21:59:28 | 00:04:39
2015-02-28 20:11:02 | 00:04:38
2015-03-01 15:19:25 | 00:04:39
2015-03-01 17:46:11 | 00:04:39
2015-03-01 22:35:02 | 00:04:40
2015-03-02 22:08:07 | 00:04:38
2015-03-03 04:39:26 | 00:04:39
2015-03-03 15:57:20 | 00:04:36
2015-03-03 16:59:36 | 00:04:42
2015-03-03 19:32:44 | 00:04:40
2015-03-03 21:59:28 | 00:04:40
2015-03-04 02:39:32 | 00:04:39
2015-03-04 03:39:32 | 00:04:38
2015-03-04 04:39:34 | 00:04:36
2015-03-04 16:22:14 | 00:04:40
2015-03-05 00:22:06 | 00:04:40
2015-03-05 01:39:25 | 00:04:38
2015-03-05 03:22:07 | 00:04:40
2015-03-05 11:20:10 | 00:04:39
2015-03-05 18:17:25 | 00:04:42
2015-03-05 19:59:37 | 00:04:38
2015-03-06 17:46:54 | 00:04:38
2015-03-06 20:33:45 | 00:04:38
2015-03-06 22:20:14 | 00:04:38
2015-03-07 04:59:51 | 00:04:40
2015-03-07 06:02:39 | 00:04:41
2015-03-08 16:04:36 | 00:04:39
2015-03-08 17:19:37 | 00:04:39
2015-03-08 21:54:10 | 00:04:38
2015-03-09 05:47:20 | 00:04:38
2015-03-09 13:59:44 | 00:04:38
2015-03-09 14:59:50 | 00:04:41
2015-03-09 18:03:40 | 00:04:41
2015-03-09 20:22:24 | 00:04:43
2015-03-09 21:39:41 | 00:04:40
2015-03-10 15:22:33 | 00:04:43
2015-03-10 16:40:01 | 00:04:42
2015-03-11 07:02:46 | 00:04:41
2015-03-11 13:39:30 | 00:04:40
2015-03-11 14:39:44 | 00:04:40
2015-03-11 16:19:33 | 00:04:45
2015-03-11 17:19:25 | 00:04:41
2015-03-11 18:19:58 | 00:04:41
2015-03-11 19:59:38 | 00:04:43
2015-03-11 20:59:42 | 00:04:44
2015-03-11 22:39:39 | 00:04:43
2015-03-12 01:39:36 | 00:04:40
2015-03-12 03:03:33 | 00:04:42
2015-03-12 04:19:47 | 00:04:42
2015-03-12 16:37:29 | 00:04:44
2015-03-12 20:49:51 | 00:04:43
2015-03-13 12:22:21 | 00:04:44
2015-03-14 01:52:44 | 00:04:39
2015-03-14 21:21:00 | 00:04:45
2015-03-15 01:59:52 | 00:04:40
2015-03-15 17:00:27 | 00:04:37
2015-03-15 19:11:55 | 00:04:38
2015-03-15 20:20:13 | 00:04:39
2015-03-15 22:59:52 | 00:04:39
2015-03-16 06:52:43 | 00:04:39
2015-03-16 15:39:39 | 00:04:41
2015-03-17 02:00:24 | 00:04:36
2015-03-17 22:39:33 | 00:04:37
2015-03-22 03:28:57 | 00:04:41
2015-03-22 18:03:55 | 00:04:40
2015-03-22 19:21:59 | 00:04:41
2015-03-23 03:19:09 | 00:04:43
2015-03-23 14:39:31 | 00:04:42
2015-03-23 15:39:18 | 00:04:40
2015-03-23 17:29:54 | 00:04:43
2015-03-23 18:39:43 | 00:04:40
2015-03-23 19:39:21 | 00:04:40
2015-03-23 21:19:25 | 00:04:41
2015-03-24 23:15:15 | 00:04:42
2015-03-25 00:19:35 | 00:04:43
2015-03-25 02:40:23 | 00:04:42
2015-03-25 17:39:30 | 00:04:43
2015-03-25 19:19:29 | 00:04:43
2015-03-25 20:40:04 | 00:04:43
2015-03-25 22:04:08 | 00:04:42
2015-03-25 23:59:48 | 00:04:43
2015-03-26 04:14:03 | 00:04:43
2015-03-26 16:22:22 | 00:04:41
2015-03-26 17:23:13 | 00:04:48
2015-03-26 18:59:43 | 00:04:49
2015-03-26 21:22:12 | 00:04:50
2015-03-26 22:39:38 | 00:04:48
2015-03-27 21:47:58 | 00:04:48
2015-03-28 00:03:34 | 00:04:50
2015-03-28 13:22:34 | 00:04:48
2015-03-28 14:39:34 | 00:04:50
2015-03-28 15:39:45 | 00:04:51
2015-03-28 17:57:30 | 00:04:50
2015-03-29 17:22:35 | 00:04:50
2015-03-29 18:39:38 | 00:04:49
2015-03-29 22:53:53 | 00:04:49
2015-03-30 00:22:27 | 00:04:51
2015-03-30 01:39:55 | 00:04:50
2015-03-30 10:39:41 | 00:04:48
2015-03-30 18:11:28 | 00:04:50
2015-03-30 19:20:10 | 00:04:51
2015-03-30 20:19:55 | 00:04:48
2015-03-31 00:53:47 | 00:04:48
2015-03-31 15:55:52 | 00:04:50
2015-03-31 17:22:25 | 00:04:54
2015-04-01 03:34:37 | 00:04:52
2015-04-01 16:39:34 | 00:04:50
2015-04-01 21:22:31 | 00:04:52
2015-04-01 22:39:39 | 00:04:49
2015-04-02 14:39:48 | 00:04:50
2015-04-02 15:41:30 | 00:04:53
2015-04-02 17:00:23 | 00:04:53
2015-04-02 20:50:25 | 00:04:52
2015-04-03 03:39:42 | 00:04:49
2015-04-03 05:28:29 | 00:04:50
2015-04-03 08:37:32 | 00:04:49
2015-04-03 10:20:00 | 00:04:50
2015-04-03 13:06:08 | 00:04:50
2015-04-03 15:20:00 | 00:04:52
2015-04-04 00:21:47 | 00:04:52
2015-04-04 03:04:03 | 00:04:50
2015-04-04 18:32:34 | 00:04:49
2015-04-05 00:49:36 | 00:04:49
2015-04-05 17:00:01 | 00:04:50
2015-04-05 19:31:55 | 00:04:50
2015-04-06 06:52:46 | 00:04:51
2015-04-06 14:20:44 | 00:04:51
2015-04-06 15:40:18 | 00:04:51
2015-04-07 19:11:57 | 00:04:50
2015-04-07 20:23:03 | 00:04:51
2015-04-08 00:52:52 | 00:04:51
2015-04-08 02:22:55 | 00:04:53
2015-04-08 03:40:01 | 00:04:48
2015-04-08 05:04:12 | 00:04:53
2015-04-08 12:11:31 | 00:04:52
2015-04-08 14:39:55 | 00:04:50
2015-04-08 19:53:45 | 00:04:50
2015-04-09 02:46:51 | 00:04:51
2015-04-09 14:49:20 | 00:04:50
2015-04-09 19:23:03 | 00:04:53
2015-04-09 20:40:06 | 00:04:51
2015-04-10 01:22:58 | 00:04:52
2015-04-10 17:04:30 | 00:04:50
2015-04-12 03:44:41 | 00:04:51
2015-04-12 10:16:26 | 00:04:50
2015-04-12 17:23:27 | 00:04:51
2015-04-12 20:04:23 | 00:04:54
2015-04-13 04:04:18 | 00:04:52
2015-04-13 05:20:24 | 00:04:54
2015-04-13 14:57:40 | 00:04:54
2015-04-13 19:37:07 | 00:04:50
2015-04-14 14:23:58 | 00:04:51
2015-04-14 19:13:29 | 00:04:51
2015-04-14 21:23:07 | 00:04:53
2015-04-24 02:57:58 | 00:04:53
2015-04-24 07:40:42 | 00:04:51
2015-04-24 13:54:47 | 00:04:52
2015-04-24 16:14:48 | 00:04:53
2015-04-24 17:34:47 | 00:04:52
2015-04-24 18:34:55 | 00:04:54
2015-04-24 21:42:47 | 00:04:55
2015-04-25 03:00:34 | 00:04:54
2015-04-25 13:14:49 | 00:04:52
2015-04-26 00:00:10 | 00:04:52
2015-04-26 01:14:53 | 00:04:54
2015-04-26 02:14:58 | 00:04:54
2015-04-26 13:54:51 | 00:04:52
2015-05-05 02:34:58 | 00:04:53
2015-05-05 16:41:25 | 00:04:54
2015-05-05 18:34:59 | 00:04:55
2015-05-05 22:33:34 | 00:04:55
2015-05-06 02:54:59 | 00:04:55
2015-05-07 09:54:59 | 00:04:55
2015-05-07 16:44:40 | 00:05:03
2015-05-07 22:35:05 | 00:05:00
2015-05-08 04:55:09 | 00:05:03
2015-05-08 11:35:10 | 00:05:02
2015-05-08 18:48:36 | 00:05:03
2015-05-08 20:35:09 | 00:05:04
2015-05-08 23:15:10 | 00:05:05
2015-05-09 03:41:25 | 00:05:05
2015-05-09 15:34:58 | 00:05:03
2015-05-09 17:55:07 | 00:05:04
2015-05-09 19:15:10 | 00:05:03
2015-05-10 03:55:01 | 00:05:04
2015-05-10 18:55:03 | 00:05:04
2015-05-11 03:45:17 | 00:05:06
2015-05-11 16:45:10 | 00:05:04
2015-05-11 21:01:44 | 00:05:05
2015-05-11 22:35:08 | 00:05:04
2015-05-12 00:55:04 | 00:05:03
2015-05-12 13:55:11 | 00:05:04
2015-05-12 16:35:08 | 00:05:04
2015-05-12 17:35:11 | 00:05:01
2015-05-12 18:35:12 | 00:05:03
2015-05-12 21:15:00 | 00:05:01
2015-05-12 22:35:07 | 00:05:03
2015-05-13 03:15:00 | 00:05:01
2015-05-13 05:55:07 | 00:05:00
2015-05-13 15:15:10 | 00:05:03
2015-05-13 18:15:06 | 00:05:03
2015-05-13 19:15:13 | 00:05:04
2015-05-13 20:15:13 | 00:05:04
2015-05-13 22:55:15 | 00:05:03
2015-05-14 18:15:13 | 00:05:03
2015-05-14 22:22:04 | 00:05:04
2015-05-15 00:15:13 | 00:05:02
2015-05-15 02:15:05 | 00:05:04
2015-05-15 03:15:21 | 00:05:04
2015-05-15 11:15:14 | 00:05:02
2015-05-15 12:55:18 | 00:05:03
2015-05-15 14:55:07 | 00:05:02
2015-05-15 15:55:17 | 00:05:03
2015-05-15 16:55:16 | 00:05:05
2015-05-15 18:15:14 | 00:05:04
2015-05-15 19:15:23 | 00:05:05
2015-05-15 20:55:14 | 00:05:06
2015-05-15 22:15:23 | 00:05:11
2015-05-16 09:55:15 | 00:05:12
2015-05-16 15:55:05 | 00:05:15
2015-05-16 20:42:35 | 00:05:12
2015-05-16 22:37:41 | 00:05:10
2015-05-17 01:42:44 | 00:05:10
2015-05-17 05:55:03 | 00:05:13
2015-05-17 09:15:15 | 00:05:10
2015-05-17 13:15:13 | 00:05:10
2015-05-17 14:15:16 | 00:05:11
2015-05-17 17:15:16 | 00:05:12
2015-05-17 23:22:25 | 00:05:12
2015-05-18 00:35:17 | 00:05:11
2015-05-18 01:35:19 | 00:05:12
2015-05-18 06:02:58 | 00:05:13
2015-05-18 07:35:09 | 00:05:13
2015-05-18 08:35:24 | 00:05:12
2015-05-18 20:15:06 | 00:05:11
2015-05-19 00:53:06 | 00:05:12
2015-05-19 03:05:24 | 00:05:11
2015-05-19 15:55:26 | 00:05:12
2015-05-19 20:03:36 | 00:05:15
2015-05-19 21:25:27 | 00:05:16
2015-05-20 02:59:16 | 00:05:11
2015-05-20 14:05:15 | 00:05:12
2015-05-20 16:55:28 | 00:05:13
2015-05-20 18:55:22 | 00:05:15
2015-05-21 05:05:10 | 00:05:13
2015-05-21 11:55:22 | 00:05:12
2015-05-21 15:55:23 | 00:05:13
2015-05-21 21:25:24 | 00:05:14
2015-05-21 23:55:24 | 00:05:15
2015-05-22 08:15:25 | 00:05:12
2015-05-22 12:45:25 | 00:05:15
2015-05-22 15:23:33 | 00:05:15
2015-05-22 22:45:23 | 00:05:15
2015-05-22 23:45:36 | 00:05:15
2015-05-23 01:05:20 | 00:05:13
2015-05-23 19:25:27 | 00:05:13
2015-05-23 20:25:47 | 00:05:12
2015-05-24 01:15:26 | 00:05:14
2015-05-24 02:15:44 | 00:05:14
2015-05-24 16:25:29 | 00:05:15
2015-05-24 20:34:33 | 00:05:17
2015-05-25 01:55:27 | 00:05:12
2015-05-25 11:55:27 | 00:05:13
2015-05-25 12:55:18 | 00:05:14
2015-05-25 15:55:28 | 00:05:17
2015-05-25 19:46:06 | 00:05:13
2015-05-25 21:05:14 | 00:05:15
2015-05-26 02:05:11 | 00:05:16
2015-05-26 16:13:32 | 00:05:14
2015-05-26 18:15:32 | 00:05:11
2015-05-27 05:34:00 | 00:05:17
2015-05-28 02:05:46 | 00:05:12
2015-05-28 17:46:26 | 00:05:17
2015-05-29 01:31:11 | 00:05:17
2015-05-29 16:05:14 | 00:05:16
2015-05-29 18:46:19 | 00:05:13
2015-05-29 23:04:22 | 00:05:16
2015-05-31 11:15:33 | 00:05:15
2015-06-01 02:55:37 | 00:05:13
2015-06-01 03:55:22 | 00:05:12
2015-06-01 15:35:18 | 00:05:13
2015-06-01 21:04:44 | 00:05:16
2015-06-03 03:15:39 | 00:05:13
2015-06-03 17:47:05 | 00:05:16
2015-06-03 22:05:38 | 00:05:18
2015-06-04 00:45:38 | 00:05:17
2015-06-04 04:25:04 | 00:05:16
2015-06-04 11:05:24 | 00:05:17
2015-06-04 14:45:38 | 00:05:16
2015-06-04 17:55:39 | 00:05:16
2015-06-04 20:26:30 | 00:05:15
2015-06-04 21:25:27 | 00:05:10
2015-06-04 22:25:27 | 00:05:10
2015-06-05 15:16:27 | 00:05:10
2015-06-05 20:34:42 | 00:05:14
2015-06-05 21:35:26 | 00:05:11
2015-06-08 00:28:50 | 00:05:30
2015-06-08 01:55:31 | 00:05:30
2015-06-08 14:41:08 | 00:05:31
2015-06-08 18:05:05 | 00:05:27
2015-06-08 19:05:29 | 00:05:26
2015-06-09 17:15:42 | 00:05:29
2015-06-09 21:52:33 | 00:05:31
2015-06-10 06:35:19 | 00:05:26
2015-06-10 20:35:09 | 00:05:25
2015-06-10 23:05:23 | 00:05:29
2015-06-11 00:05:29 | 00:05:30
2015-06-11 01:35:44 | 00:05:29
2015-06-11 02:35:31 | 00:05:27
2015-06-11 04:15:45 | 00:05:27
2015-06-11 13:45:48 | 00:05:27
2015-06-11 14:55:33 | 00:05:28
2015-06-11 16:05:31 | 00:05:28
2015-06-12 03:05:07 | 00:05:27
2015-06-12 04:05:31 | 00:05:28
2015-06-12 13:15:46 | 00:05:28
2015-06-12 14:25:29 | 00:05:29
2015-06-12 15:55:09 | 00:05:28
2015-06-12 19:20:39 | 00:05:30
2015-06-12 23:35:21 | 00:05:28
2015-06-13 01:55:47 | 00:05:25
2015-06-13 02:55:31 | 00:05:27
2015-06-14 01:05:26 | 00:05:28
2015-06-14 02:05:32 | 00:05:27
2015-06-14 17:45:49 | 00:05:27
2015-06-15 15:52:09 | 00:05:30
2015-06-16 03:35:21 | 00:05:25
2015-06-17 12:25:47 | 00:05:28
2015-06-19 20:12:05 | 00:05:34
2015-06-20 18:11:39 | 00:05:30
2015-06-21 14:45:52 | 00:05:27
2015-06-21 17:35:42 | 00:05:26
2015-06-21 20:20:26 | 00:05:31
2015-06-22 00:15:10 | 00:05:26
2015-06-22 18:25:53 | 00:05:30
2015-06-23 01:10:04 | 00:05:30
2015-06-23 12:55:55 | 00:05:27
2015-06-23 14:25:57 | 00:05:28
2015-06-24 13:35:55 | 00:05:29
2015-06-25 17:43:03 | 00:05:31
2015-06-25 22:45:07 | 00:05:10
2015-06-26 09:45:13 | 00:05:10
2015-06-26 13:46:02 | 00:05:12
2015-06-26 15:16:00 | 00:05:11
2015-06-26 16:15:36 | 00:05:10
2015-06-26 18:25:56 | 00:05:13
2015-06-26 19:25:36 | 00:05:10
2015-06-26 20:25:37 | 00:05:13
2015-06-26 21:25:35 | 00:05:10
2015-06-26 22:25:36 | 00:05:11
2015-06-27 00:16:20 | 00:05:13
2015-06-27 07:26:35 | 00:05:11
2015-06-27 15:58:41 | 00:05:13
2015-06-27 18:14:04 | 00:05:12
2015-06-27 21:56:01 | 00:05:11
2015-06-28 11:50:51 | 00:05:13
2015-06-28 19:26:41 | 00:05:11
2015-06-28 20:45:37 | 00:05:10
2015-06-28 21:45:39 | 00:05:08
2015-06-29 00:24:51 | 00:05:10
2015-06-29 01:35:38 | 00:05:11
2015-06-29 04:16:13 | 00:05:08
2015-06-29 12:55:13 | 00:05:11
2015-06-29 16:46:04 | 00:05:13
2015-06-29 19:46:09 | 00:05:13
2015-06-29 21:16:02 | 00:05:09
2015-06-30 03:55:13 | 00:05:10
2015-06-30 11:49:23 | 00:05:13
2015-06-30 16:56:02 | 00:05:10
2015-06-30 21:07:13 | 00:05:13
2015-07-01 02:05:15 | 00:05:07
2015-07-01 22:23:40 | 00:05:12
2015-07-02 00:22:06 | 00:05:11
2015-07-02 02:42:55 | 00:05:13
2015-07-02 04:41:48 | 00:05:11
2015-07-02 10:22:07 | 00:05:12
2015-07-02 16:26:23 | 00:05:10
2015-07-02 18:21:25 | 00:05:11
2015-07-02 19:26:07 | 00:05:13
2015-07-02 20:46:34 | 00:05:12
2015-07-02 23:01:25 | 00:05:13
2015-07-03 04:01:17 | 00:05:13
2015-07-03 07:56:23 | 00:05:13
2015-07-03 10:39:57 | 00:05:13
2015-07-03 19:56:24 | 00:05:12
2015-07-03 21:06:30 | 00:05:12
2015-07-05 20:13:28 | 00:05:13
2015-07-06 00:41:48 | 00:05:14
2015-07-06 15:13:14 | 00:05:12
2015-07-06 19:26:27 | 00:05:11
2015-07-07 03:22:21 | 00:05:14
2015-07-07 12:17:13 | 00:05:12
2015-07-07 14:59:18 | 00:05:11
2015-07-07 20:11:52 | 00:05:12
2015-07-07 22:41:45 | 00:05:13
2015-07-08 18:46:01 | 00:05:12
2015-07-08 22:12:03 | 00:05:12
2015-07-09 05:26:45 | 00:05:13
2015-07-09 09:21:52 | 00:05:12
2015-07-09 10:35:55 | 00:05:10
2015-07-09 17:22:14 | 00:05:14
2015-07-09 22:30:55 | 00:05:14
2015-07-10 02:41:28 | 00:05:14
2015-07-10 12:52:02 | 00:05:13
2015-07-11 22:22:06 | 00:05:15
2015-07-12 03:51:47 | 00:05:15
2015-07-12 21:25:17 | 00:05:11
2015-07-13 02:03:09 | 00:05:14
2015-07-14 14:34:40 | 00:05:11
2015-07-14 16:31:16 | 00:05:15
2015-07-14 18:06:07 | 00:05:10
2015-07-14 21:32:08 | 00:05:14
2015-07-15 15:12:13 | 00:05:13
2015-07-16 05:13:17 | 00:05:14
2015-07-16 09:21:25 | 00:05:15
2015-07-17 07:11:42 | 00:05:16
2015-07-17 12:26:25 | 00:05:13
2015-07-17 13:26:13 | 00:05:12
2015-07-17 18:16:44 | 00:05:10
2015-07-17 20:52:48 | 00:05:12
2015-07-18 02:13:54 | 00:05:14
2015-07-18 15:12:22 | 00:05:14
2015-07-18 19:22:26 | 00:05:17
2015-07-19 18:22:37 | 00:05:13
2015-07-20 09:17:58 | 00:05:15
2015-07-20 11:46:31 | 00:05:12
2015-07-20 16:54:44 | 00:05:12
2015-07-20 20:52:40 | 00:05:16
2015-07-21 12:32:55 | 00:05:13
2015-07-21 15:01:29 | 00:05:15
2015-07-21 18:44:32 | 00:05:12
2015-07-22 01:50:49 | 00:05:13
2015-07-23 02:45:21 | 00:05:13
2015-07-23 14:52:44 | 00:05:15
2015-07-24 11:10:03 | 00:05:16
2015-07-24 14:52:37 | 00:05:11
2015-07-24 21:01:47 | 00:05:15
2015-07-26 01:27:31 | 00:05:17
2015-07-26 16:13:00 | 00:05:15
2015-07-26 18:11:50 | 00:05:17
2015-07-26 23:34:31 | 00:05:15
2015-07-27 09:52:43 | 00:05:16
2015-07-27 19:37:36 | 00:05:13
2015-07-27 21:42:28 | 00:05:15
2015-07-28 04:32:13 | 00:05:16
2015-07-28 07:13:19 | 00:05:16
2015-07-28 08:47:10 | 00:05:16
2015-07-28 20:34:38 | 00:05:16
2015-07-29 02:41:27 | 00:05:18
2015-07-29 09:01:47 | 00:05:16
2015-07-29 11:47:44 | 00:05:15
2015-07-29 15:37:16 | 00:05:15
2015-07-29 16:47:22 | 00:05:14
2015-07-29 18:41:59 | 00:05:16
2015-07-29 19:46:24 | 00:05:16
2015-07-29 20:57:21 | 00:05:15
2015-07-29 23:51:42 | 00:05:17
2015-07-30 01:37:29 | 00:05:16
2015-07-30 07:16:12 | 00:05:17
2015-07-30 11:27:18 | 00:05:16
2015-07-30 13:32:25 | 00:05:17
2015-07-30 20:27:48 | 00:05:15
2015-07-31 02:41:39 | 00:05:18
2015-08-01 02:03:26 | 00:05:17
2015-08-01 19:33:09 | 00:05:18
2015-08-02 05:12:43 | 00:05:17
2015-08-02 18:17:52 | 00:05:21
2015-08-03 00:02:07 | 00:05:19
2015-08-03 01:07:22 | 00:05:16
2015-08-03 04:54:43 | 00:05:15
2015-08-03 13:33:30 | 00:05:17
2015-08-03 15:32:35 | 00:05:18
2015-08-03 17:32:30 | 00:05:18
2015-08-03 20:33:33 | 00:05:19
2015-08-04 15:07:30 | 00:05:16
2015-08-04 17:22:29 | 00:05:17
2015-08-04 22:34:32 | 00:05:19
2015-08-05 04:07:45 | 00:05:19
2015-08-05 12:43:34 | 00:05:18
2015-08-05 16:26:08 | 00:05:22
2015-08-05 18:16:35 | 00:05:21
2015-08-05 23:38:31 | 00:05:23
2015-08-06 01:56:03 | 00:05:18
2015-08-06 03:07:42 | 00:05:21
2015-08-06 11:51:00 | 00:05:20
2015-08-06 17:43:16 | 00:05:18
2015-08-06 20:43:22 | 00:05:20
2015-08-07 01:59:02 | 00:05:19
2015-08-07 05:37:49 | 00:05:19
2015-08-07 14:14:32 | 00:05:20
2015-08-07 20:03:16 | 00:05:22
2015-08-07 23:27:46 | 00:05:21
2015-08-08 18:44:39 | 00:05:19
2015-08-08 21:37:42 | 00:05:17
2015-08-09 01:44:10 | 00:05:23
2015-08-09 03:43:15 | 00:05:22
2015-08-09 15:27:24 | 00:05:18
2015-08-10 00:06:23 | 00:05:19
2015-08-10 13:25:51 | 00:05:17
2015-08-10 15:33:11 | 00:05:20
2015-08-11 00:46:33 | 00:05:21
2015-08-11 12:48:02 | 00:05:21
2015-08-11 13:56:44 | 00:05:21
2015-08-11 15:06:42 | 00:05:20
2015-08-11 17:47:51 | 00:05:22
2015-08-12 03:57:57 | 00:05:21
2015-08-12 09:15:59 | 00:05:19
2015-08-12 16:44:45 | 00:05:20
2015-08-12 18:43:22 | 00:05:21
2015-08-13 05:37:07 | 00:05:19
2015-08-13 15:49:51 | 00:05:20
2015-08-13 18:03:32 | 00:05:19
2015-08-13 23:33:19 | 00:05:24
2015-08-14 04:07:59 | 00:05:20
2015-08-14 13:28:01 | 00:05:22
2015-08-14 16:16:20 | 00:05:20
2015-08-15 02:56:49 | 00:05:19
2015-08-15 04:06:49 | 00:05:19
2015-08-15 16:26:31 | 00:05:19
2015-08-15 21:49:52 | 00:05:19
2015-08-17 07:27:59 | 00:05:19
2015-08-17 11:28:23 | 00:05:19
2015-08-17 23:48:03 | 00:05:18
2015-08-18 18:05:39 | 00:05:19
2015-08-19 06:37:37 | 00:05:18
2015-08-19 14:35:16 | 00:05:18
2015-08-19 16:55:11 | 00:05:19
2015-08-20 16:36:41 | 00:05:18
2015-08-21 03:55:17 | 00:05:19
2015-08-21 13:50:34 | 00:05:20
2015-08-21 20:13:38 | 00:05:21
2015-08-22 00:28:08 | 00:05:21
2015-08-22 05:50:15 | 00:05:22
2015-08-22 13:26:18 | 00:05:20
2015-08-22 14:36:26 | 00:05:19
2015-08-23 03:05:24 | 00:05:20
2015-08-23 17:45:22 | 00:05:20
2015-08-23 19:53:45 | 00:05:20
2015-08-23 21:38:08 | 00:05:19
2015-08-25 16:45:40 | 00:05:19
2015-08-25 17:46:53 | 00:05:23
2015-08-25 19:06:54 | 00:05:20
2015-08-26 03:32:32 | 00:05:24
2015-08-26 15:35:27 | 00:05:21
2015-08-26 19:47:18 | 00:05:22
2015-08-26 22:28:12 | 00:05:18
2015-08-27 20:50:32 | 00:05:24
2015-08-28 03:56:00 | 00:05:21
2015-08-28 14:38:14 | 00:05:23
2015-08-28 16:45:59 | 00:05:19
2015-08-30 01:25:16 | 00:05:20
2015-08-30 20:50:40 | 00:05:21
2015-08-31 05:48:19 | 00:05:22
2015-08-31 13:16:04 | 00:05:20
2015-08-31 18:16:49 | 00:05:19
2015-08-31 20:11:54 | 00:05:23
2015-08-31 22:15:00 | 00:05:19
2015-09-01 18:08:21 | 00:05:22
2015-09-01 21:36:25 | 00:05:21
2015-09-01 23:44:10 | 00:05:20
2015-09-02 17:18:24 | 00:05:23
2015-09-02 20:28:22 | 00:05:22
2015-09-03 05:36:21 | 00:05:20
2015-09-03 15:26:48 | 00:05:20
2015-09-03 17:36:26 | 00:05:25
2015-09-04 09:58:23 | 00:05:21
2015-09-04 22:21:38 | 00:05:19
2015-09-05 01:46:09 | 00:05:20
2015-09-05 13:23:36 | 00:05:20
2015-09-05 16:06:53 | 00:05:22
2015-09-05 23:01:07 | 00:05:21
2015-09-06 02:48:18 | 00:05:24
2015-09-06 11:42:22 | 00:05:22
2015-09-06 12:48:27 | 00:05:21
2015-09-06 18:36:44 | 00:05:19
2015-09-07 16:45:06 | 00:05:19
2015-09-07 22:03:31 | 00:05:20
2015-09-08 03:22:52 | 00:05:24
2015-09-08 18:35:05 | 00:05:22
2015-09-09 00:26:10 | 00:05:22
2015-09-09 19:23:11 | 00:05:21
2015-09-10 00:16:33 | 00:05:24
2015-09-10 14:56:31 | 00:05:23
2015-09-11 02:56:58 | 00:05:21
2015-09-11 06:41:16 | 00:05:45
2015-09-11 18:08:35 | 00:05:25
2015-09-11 22:12:38 | 00:05:19
2015-09-12 06:05:03 | 00:05:23
2015-09-12 22:26:40 | 00:05:22
2015-09-13 05:16:39 | 00:05:19
2015-09-13 21:16:31 | 00:05:22
2015-09-13 23:24:33 | 00:05:20
2015-09-14 13:28:40 | 00:05:21
2015-09-15 06:48:40 | 00:05:22
2015-09-15 15:27:04 | 00:05:22
2015-09-15 19:28:39 | 00:05:22
2015-09-15 22:02:08 | 00:05:24
2015-09-16 06:27:41 | 00:05:23
2015-09-16 14:26:34 | 00:05:23
2015-09-16 17:08:06 | 00:05:23
2015-09-16 19:44:55 | 00:05:22
2015-09-17 11:28:35 | 00:05:23
2015-09-17 13:48:35 | 00:05:24
2015-09-17 15:36:52 | 00:05:21
2015-09-17 20:02:45 | 00:05:20
2015-09-18 01:06:34 | 00:05:22
2015-09-18 11:42:49 | 00:05:23
2015-09-18 17:56:31 | 00:05:23
2015-09-18 23:23:48 | 00:05:24
2015-09-19 02:06:56 | 00:05:24
2015-09-19 04:26:02 | 00:05:21
2015-09-21 01:15:39 | 00:05:21
2015-09-21 20:37:41 | 00:05:24
2015-09-22 03:06:59 | 00:05:22
2015-09-22 05:15:45 | 00:05:22
2015-09-22 10:27:19 | 00:05:24
2015-09-22 15:49:53 | 00:05:24
2015-09-23 01:48:48 | 00:05:22
2015-09-23 12:38:48 | 00:05:23
2015-09-23 15:06:59 | 00:05:19
2015-09-23 16:17:14 | 00:05:22
2015-09-23 23:35:26 | 00:05:23
2015-09-24 17:26:24 | 00:05:22
2015-09-24 23:48:00 | 00:05:26
2015-09-25 07:29:58 | 00:05:24
2015-09-25 20:50:21 | 00:05:25
2015-09-26 18:25:19 | 00:05:24
2015-09-27 02:07:27 | 00:05:25
2015-09-27 16:47:51 | 00:05:25
2015-09-28 00:36:43 | 00:05:25
2015-09-28 15:57:49 | 00:05:23
2015-09-28 18:37:41 | 00:05:27
2015-09-28 20:57:36 | 00:05:24
2015-09-28 23:08:01 | 00:05:26
2015-09-29 04:34:46 | 00:05:24
2015-09-29 12:58:08 | 00:05:24
2015-09-29 18:48:56 | 00:05:22
2015-09-30 02:57:54 | 00:05:23
2015-09-30 11:40:06 | 00:05:22
2015-09-30 23:46:07 | 00:05:24
2015-10-01 07:56:56 | 00:05:24
2015-10-01 13:29:02 | 00:05:25
2015-10-01 18:54:22 | 00:05:22
2015-10-01 21:06:25 | 00:05:25
2015-10-02 02:58:05 | 00:05:25
2015-10-02 16:57:54 | 00:05:23
2015-10-02 23:35:01 | 00:05:22
2015-10-03 05:51:24 | 00:05:23
2015-10-03 14:16:24 | 00:05:26
2015-10-03 19:39:17 | 00:05:25
2015-10-04 01:28:14 | 00:05:28
2015-10-04 02:37:25 | 00:05:26
2015-10-04 17:48:14 | 00:05:26
2015-10-04 23:21:29 | 00:05:24
2015-10-05 05:20:12 | 00:05:24
2015-10-05 15:02:44 | 00:05:25
2015-10-05 21:17:39 | 00:05:26
2015-10-06 02:33:58 | 00:05:22
2015-10-06 19:59:17 | 00:05:25
2015-10-06 21:16:58 | 00:05:24
2015-10-07 14:18:53 | 00:05:27
2015-10-07 16:26:29 | 00:05:25
2015-10-08 00:08:45 | 00:05:29
2015-10-08 15:42:17 | 00:05:25
2015-10-08 16:47:31 | 00:05:23
2015-10-08 19:06:46 | 00:05:26
2015-10-09 16:10:12 | 00:05:27
2015-10-09 18:39:25 | 00:05:22
2015-10-09 19:57:32 | 00:05:25
2015-10-09 23:49:26 | 00:05:25
2015-10-12 01:48:41 | 00:05:27
2015-10-12 04:47:07 | 00:05:27
2015-10-13 02:30:13 | 00:05:27
2015-10-13 19:20:50 | 00:05:28
2015-10-13 21:30:22 | 00:05:28
2015-10-13 23:36:48 | 00:05:28
2015-10-15 16:28:16 | 00:05:27
2015-10-15 18:53:19 | 00:05:26
2015-10-16 14:59:01 | 00:05:26
2015-10-16 17:07:06 | 00:05:24
2015-10-16 19:39:21 | 00:05:25
2015-10-17 00:44:09 | 00:05:33
2015-10-19 20:56:36 | 00:05:35
2015-10-20 07:55:32 | 00:05:32
2015-10-20 13:29:14 | 00:05:34
2015-10-20 15:37:02 | 00:05:32
2015-10-20 17:49:43 | 00:05:34
2015-10-20 21:01:42 | 00:05:32
2015-10-22 02:39:19 | 00:05:32
2015-10-22 14:47:22 | 00:05:34
2015-10-22 15:57:17 | 00:05:31
2015-10-22 17:07:20 | 00:05:34
2015-10-22 19:19:00 | 00:05:32
2015-10-22 20:46:41 | 00:05:33
2015-10-22 23:47:37 | 00:05:32
2015-10-23 04:09:37 | 00:05:32
2015-10-28 03:09:05 | 00:05:33
2015-10-28 13:53:18 | 00:05:32
2015-10-29 02:20:53 | 00:05:31
2015-10-29 20:49:29 | 00:05:33
2015-10-29 22:56:45 | 00:05:33
2015-10-30 11:45:42 | 00:05:33
2015-10-30 23:17:31 | 00:05:33
2015-10-31 23:50:58 | 00:05:35
2015-11-02 15:15:39 | 00:05:30
2015-11-02 23:37:21 | 00:05:32
2015-11-03 01:07:28 | 00:05:34
2015-11-03 13:59:30 | 00:05:34
2015-11-03 16:58:01 | 00:05:34
2015-11-03 19:09:48 | 00:05:34
2015-11-03 21:17:01 | 00:05:32
2015-11-03 23:49:34 | 00:05:34
2015-11-04 17:09:33 | 00:05:33
2015-11-05 02:59:32 | 00:05:33
2015-11-05 15:59:35 | 00:05:32
2015-11-05 18:30:48 | 00:05:30
2015-11-05 19:37:30 | 00:05:30
2015-11-05 23:16:51 | 00:05:33
2015-11-06 05:39:33 | 00:05:34
2015-11-06 16:19:36 | 00:05:33
2015-11-06 18:29:11 | 00:05:34
2015-11-06 22:07:23 | 00:05:31
2015-11-07 04:12:19 | 00:05:31
2015-11-07 21:41:44 | 00:05:31
2015-11-08 00:22:45 | 00:05:31
2015-11-08 01:39:42 | 00:05:33
2015-11-09 02:41:28 | 00:05:33
2015-11-09 07:07:05 | 00:05:33
2015-11-09 16:02:24 | 00:05:32
2015-11-09 18:59:44 | 00:05:33
2015-11-11 01:01:00 | 00:05:33
2015-11-11 05:11:09 | 00:05:33
2015-11-11 11:37:27 | 00:05:35
2015-11-11 14:09:51 | 00:05:33
2015-11-11 18:49:42 | 00:05:33
2015-11-11 23:19:18 | 00:05:35
2015-11-12 01:29:29 | 00:05:34
2015-11-12 12:47:39 | 00:05:32
2015-11-12 14:29:42 | 00:05:35
2015-11-12 20:47:45 | 00:05:34
2015-11-12 22:57:22 | 00:05:35
2015-11-13 17:19:40 | 00:05:35
2015-11-14 20:55:50 | 00:05:11
2015-11-15 23:40:56 | 00:05:12
2015-11-16 18:46:52 | 00:05:13
2015-11-16 23:59:43 | 00:05:12
2015-11-17 02:07:04 | 00:05:09
2015-11-17 04:21:46 | 00:05:11
2015-11-17 13:04:48 | 00:05:09
2015-11-17 21:10:02 | 00:05:12
2015-11-18 13:37:26 | 00:05:12
2015-11-18 17:49:47 | 00:05:13
2015-11-18 20:37:25 | 00:05:14
2015-11-18 22:46:54 | 00:05:13
2015-11-19 03:47:19 | 00:05:13
2015-11-19 06:48:18 | 00:05:11
2015-11-19 09:48:10 | 00:05:13
2015-11-19 15:59:55 | 00:05:11
2015-11-19 20:29:35 | 00:05:12
2015-11-19 22:36:26 | 00:05:09
2015-11-20 18:29:57 | 00:05:13
2015-11-20 19:56:56 | 00:05:12
2015-11-22 05:21:36 | 00:05:11
2015-11-23 15:29:37 | 00:05:12
2015-11-23 17:39:53 | 00:05:13
2015-11-24 04:19:19 | 00:05:14
2015-11-25 02:20:56 | 00:05:12
2015-11-25 14:07:40 | 00:05:14
2015-11-25 21:19:56 | 00:05:10
2015-11-26 02:30:56 | 00:05:13
2015-11-26 22:20:05 | 00:05:13
2015-11-27 16:20:03 | 00:05:13
2015-11-27 19:17:47 | 00:05:14
2015-11-27 22:00:10 | 00:05:10
2015-11-27 23:07:43 | 00:05:15
2015-11-28 18:50:01 | 00:05:12
2015-11-30 00:33:45 | 00:05:14
2015-11-30 18:09:47 | 00:05:12
2015-11-30 23:59:47 | 00:05:12
2015-12-01 15:57:04 | 00:05:12
2015-12-01 21:01:08 | 00:05:14
2015-12-02 01:58:38 | 00:05:13
2015-12-02 13:37:01 | 00:05:11
2015-12-02 21:59:57 | 00:05:14
2015-12-03 00:30:48 | 00:05:13
2015-12-03 02:17:02 | 00:05:14
2015-12-03 17:00:08 | 00:05:13
2015-12-03 20:40:54 | 00:05:12
2015-12-03 23:30:39 | 00:05:12
2015-12-04 21:39:17 | 00:05:11
2015-12-05 17:00:06 | 00:05:13
2015-12-05 19:29:49 | 00:05:13
2015-12-08 01:31:17 | 00:05:12
2015-12-08 19:07:17 | 00:05:12
2015-12-08 20:27:46 | 00:05:13
2015-12-08 23:59:09 | 00:05:11
2015-12-09 18:29:59 | 00:05:10
2015-12-10 19:18:48 | 00:05:11
2015-12-11 04:37:42 | 00:05:12
2015-12-11 18:40:55 | 00:05:12
2015-12-11 23:12:20 | 00:05:17
2015-12-12 04:51:53 | 00:05:14
2015-12-12 17:31:47 | 00:05:12
2015-12-13 18:47:04 | 00:05:13
2015-12-13 20:00:22 | 00:05:13
2015-12-14 14:36:58 | 00:05:13
2015-12-14 16:57:11 | 00:05:17
2015-12-14 22:00:02 | 00:05:14
2015-12-15 02:11:04 | 00:05:14
2015-12-15 17:00:21 | 00:05:11
2015-12-15 19:00:21 | 00:05:12
2015-12-15 21:20:22 | 00:05:15
2015-12-16 13:00:25 | 00:05:12
2015-12-16 20:37:47 | 00:05:13
2015-12-17 02:30:30 | 00:05:14
2015-12-17 17:27:13 | 00:05:12
2015-12-17 21:57:16 | 00:05:16
2015-12-18 02:59:23 | 00:05:12
2015-12-18 11:50:26 | 00:05:12
2015-12-18 13:08:01 | 00:05:16
2015-12-20 04:27:05 | 00:05:13
2015-12-20 18:30:19 | 00:05:12
2015-12-21 03:31:52 | 00:05:11
2015-12-21 16:40:42 | 00:05:13
2015-12-21 20:20:28 | 00:05:13
2015-12-22 19:00:25 | 00:05:13
2015-12-22 21:23:33 | 00:05:13
2015-12-23 02:10:22 | 00:05:15
2015-12-23 03:47:58 | 00:05:14
2015-12-23 18:50:36 | 00:05:13
2015-12-23 22:35:47 | 00:05:12
2015-12-24 01:20:29 | 00:05:13
2015-12-24 18:28:51 | 00:05:13
2015-12-25 10:20:27 | 00:05:12
2015-12-25 13:57:14 | 00:05:15
2015-12-26 17:57:15 | 00:05:14
2015-12-26 20:07:57 | 00:05:12
2015-12-27 18:02:28 | 00:05:12
2015-12-28 17:19:55 | 00:05:12
2015-12-28 19:50:36 | 00:05:11
2015-12-28 22:16:39 | 00:05:11
2015-12-29 21:47:19 | 00:05:15
2015-12-30 00:48:22 | 00:05:13
2015-12-30 22:20:36 | 00:05:14
2015-12-30 23:27:57 | 00:05:13
2015-12-31 22:50:38 | 00:05:10
2016-01-01 00:58:09 | 00:05:15
2016-01-01 07:00:36 | 00:05:14
2016-01-01 19:12:53 | 00:05:12
2016-01-02 00:19:49 | 00:05:14
2016-01-02 03:07:46 | 00:05:15
2016-01-02 22:39:40 | 00:05:13
2016-01-03 03:18:28 | 00:05:13
2016-01-03 18:57:17 | 00:05:14
2016-01-03 21:27:20 | 00:05:13
2016-01-04 03:00:36 | 00:05:13
2016-01-04 07:10:36 | 00:05:18
2016-01-04 17:00:32 | 00:05:16
2016-01-04 19:07:48 | 00:05:13
2016-01-05 01:57:29 | 00:05:12
2016-01-05 17:10:26 | 00:05:15
2016-01-05 18:18:15 | 00:05:14
2016-01-05 20:10:27 | 00:05:16
2016-01-05 23:56:01 | 00:05:13
2016-01-06 16:20:09 | 00:05:16
2016-01-06 17:30:09 | 00:05:19
2016-01-07 19:04:41 | 00:05:13
2016-01-07 20:07:54 | 00:05:14
2016-01-08 01:11:28 | 00:05:17
2016-01-08 05:08:06 | 00:05:16
2016-01-08 09:03:26 | 00:05:14
2016-01-08 15:00:14 | 00:05:15
2016-01-08 16:30:15 | 00:05:14
2016-01-09 10:20:20 | 00:05:14
2016-01-09 22:05:37 | 00:05:14
2016-01-10 03:11:15 | 00:05:14
2016-01-11 02:37:28 | 00:05:16
2016-01-12 01:59:27 | 00:05:14
2016-01-12 07:40:12 | 00:05:25
2016-01-12 08:48:03 | 00:05:15
2016-01-13 02:30:23 | 00:05:14
2016-01-13 21:00:23 | 00:05:16
2016-01-13 23:59:52 | 00:05:12
2016-01-14 16:11:55 | 00:05:14
2016-01-14 17:18:03 | 00:05:12
2016-01-15 08:15:08 | 00:05:12
2016-01-15 09:30:16 | 00:05:13
2016-01-17 02:20:27 | 00:05:14
2016-01-17 17:49:36 | 00:05:14
2016-01-18 00:20:33 | 00:05:14
2016-01-18 01:28:11 | 00:05:12
2016-01-18 03:57:33 | 00:05:13
2016-01-19 12:40:34 | 00:05:11
2016-01-19 17:10:32 | 00:05:11
2016-01-19 23:57:41 | 00:05:12
2016-01-20 03:40:31 | 00:05:13
2016-01-20 08:35:33 | 00:05:09
2016-01-20 17:17:31 | 00:05:13
2016-01-20 19:07:32 | 00:05:10
2016-01-20 20:38:09 | 00:05:10
2016-01-21 01:30:33 | 00:05:12
2016-01-21 02:40:37 | 00:05:13
2016-01-21 03:48:09 | 00:05:09
2016-01-21 16:37:53 | 00:05:13
2016-01-21 17:57:35 | 00:05:11
2016-01-22 01:00:40 | 00:05:11
2016-01-22 02:18:12 | 00:05:13
2016-01-22 03:27:45 | 00:05:13
2016-01-22 18:16:55 | 00:05:11
2016-01-22 20:00:38 | 00:05:14
2016-01-22 21:08:12 | 00:05:13
2016-01-23 00:09:10 | 00:05:14
2016-01-23 12:10:36 | 00:05:12
2016-01-23 16:27:34 | 00:05:14
2016-01-23 21:30:39 | 00:05:13
2016-01-23 23:20:39 | 00:05:13
2016-01-24 18:00:36 | 00:05:15
2016-01-24 19:08:07 | 00:05:11
2016-01-26 01:19:23 | 00:05:13
2016-01-26 15:00:38 | 00:05:16
2016-01-26 20:30:37 | 00:05:14
2016-01-27 01:23:46 | 00:05:12
2016-01-27 02:28:10 | 00:05:14
2016-01-28 03:00:42 | 00:05:13
2016-01-28 04:08:13 | 00:05:14
2016-01-28 08:00:42 | 00:05:14
2016-01-28 17:30:42 | 00:05:16
2016-01-28 19:20:52 | 00:05:13
2016-01-28 21:47:34 | 00:05:14
2016-01-29 13:34:01 | 00:05:13
2016-01-29 15:08:08 | 00:05:16
2016-01-30 15:40:40 | 00:05:15
2016-01-30 21:07:55 | 00:05:13
2016-02-01 09:19:31 | 00:05:13
2016-02-01 10:48:10 | 00:05:13
2016-02-01 15:34:13 | 00:05:15
2016-02-02 12:00:53 | 00:05:17
2016-02-02 14:36:54 | 00:05:14
2016-02-02 18:41:23 | 00:05:13
2016-02-02 20:27:40 | 00:05:15
2016-02-03 02:40:57 | 00:05:15
2016-02-03 09:23:58 | 00:05:13
2016-02-03 14:20:55 | 00:05:14
2016-02-03 18:20:32 | 00:05:19
2016-02-03 19:51:04 | 00:05:13
2016-02-04 05:27:42 | 00:05:14
2016-02-04 21:50:57 | 00:05:13
2016-02-04 23:28:17 | 00:05:16
2016-02-05 01:50:59 | 00:05:15
2016-02-05 05:27:59 | 00:05:14
2016-02-05 13:08:06 | 00:05:11
2016-02-05 14:18:17 | 00:05:15
2016-02-05 19:57:40 | 00:05:14
2016-02-06 01:27:40 | 00:05:15
2016-02-06 17:30:54 | 00:05:14
2016-02-06 21:08:59 | 00:05:14
2016-02-07 04:21:04 | 00:05:17
2016-02-07 15:31:02 | 00:05:14
2016-02-07 16:58:24 | 00:05:14
2016-02-07 19:26:59 | 00:05:17
2016-02-07 21:37:27 | 00:05:19
2016-02-08 10:07:46 | 00:05:18
2016-02-08 14:51:00 | 00:05:16
2016-02-08 19:48:01 | 00:05:16
2016-02-08 21:57:42 | 00:05:16
2016-02-09 03:45:32 | 00:05:15
2016-02-09 16:31:02 | 00:05:16
2016-02-09 20:50:58 | 00:05:16
2016-02-10 00:37:36 | 00:05:15
2016-02-10 13:30:58 | 00:05:16
2016-02-10 15:21:03 | 00:05:16
2016-02-10 21:11:01 | 00:05:15
2016-02-11 04:31:35 | 00:05:17
2016-02-11 13:44:20 | 00:05:14
2016-02-11 16:41:04 | 00:05:14
2016-02-11 17:48:18 | 00:05:17
2016-02-11 19:21:18 | 00:05:15
2016-02-11 20:48:18 | 00:05:15
2016-02-11 21:58:19 | 00:05:16
2016-02-11 23:08:20 | 00:05:15
2016-02-12 04:30:59 | 00:05:16
2016-02-12 20:38:39 | 00:05:16
2016-02-12 22:21:06 | 00:05:14
2016-02-12 23:28:21 | 00:05:14
2016-02-13 20:51:05 | 00:05:15
2016-02-15 07:51:05 | 00:05:14
2016-02-15 17:17:44 | 00:05:17
2016-02-15 21:31:02 | 00:05:17
2016-02-16 02:35:41 | 00:05:17
2016-02-16 13:51:15 | 00:05:18
2016-02-17 06:06:32 | 00:05:14
2016-02-17 10:21:13 | 00:05:14
2016-02-17 17:21:20 | 00:05:13
2016-02-17 19:18:23 | 00:05:16
2016-02-18 02:31:11 | 00:05:15
2016-02-19 00:40:34 | 00:05:17
2016-02-19 03:22:28 | 00:05:16
2016-02-19 08:41:00 | 00:05:15
2016-02-20 05:00:02 | 00:05:15
2016-02-20 11:21:12 | 00:05:14
2016-02-20 16:01:13 | 00:05:16
2016-02-21 09:01:14 | 00:05:14
2016-02-21 10:31:18 | 00:05:15
2016-02-21 12:11:15 | 00:05:19
2016-02-21 16:50:13 | 00:05:17
2016-02-22 07:59:46 | 00:05:17
2016-02-22 16:31:18 | 00:05:15
2016-02-22 19:41:22 | 00:05:17
2016-02-25 06:40:17 | 00:05:18
2016-02-25 07:51:24 | 00:05:19
2016-02-26 01:51:04 | 00:05:17
2016-02-26 07:21:25 | 00:05:16
2016-02-26 10:47:52 | 00:05:17
2016-02-26 11:58:31 | 00:10:59
2016-02-26 16:38:23 | 00:05:18
2016-02-26 19:21:10 | 00:05:16
2016-02-26 20:28:32 | 00:05:17
2016-02-27 17:41:25 | 00:05:18
2016-02-28 14:51:20 | 00:05:16
2016-02-29 08:37:08 | 00:05:16
2016-02-29 14:47:15 | 00:05:18
2016-02-29 17:47:22 | 00:05:17
2016-02-29 19:37:52 | 00:05:18
2016-03-01 01:07:14 | 00:05:17
2016-03-01 06:02:20 | 00:05:16
2016-03-01 18:21:32 | 00:05:14
2016-03-01 19:28:33 | 00:05:16
2016-03-01 23:01:07 | 00:05:18
2016-03-02 01:11:25 | 00:05:18
2016-03-02 03:01:33 | 00:05:16
2016-03-02 06:07:50 | 00:13:30
2016-03-02 17:21:31 | 00:05:15
2016-03-02 18:28:33 | 00:05:16
2016-03-02 19:38:33 | 00:05:16
2016-03-02 21:31:27 | 00:05:16
2016-03-02 22:51:35 | 00:05:16
2016-03-03 06:30:43 | 00:05:16
2016-03-03 07:47:55 | 00:05:17
2016-03-03 09:56:23 | 00:05:18
2016-03-03 16:01:27 | 00:05:16
2016-03-03 17:08:33 | 00:05:16
2016-03-03 21:08:30 | 00:05:17
2016-03-03 22:51:30 | 00:05:16
2016-03-04 03:21:09 | 00:05:17
2016-03-04 16:11:12 | 00:05:15
2016-03-04 20:18:41 | 00:05:19
2016-03-04 22:41:16 | 00:05:17
2016-03-05 19:38:31 | 00:05:17
2016-03-06 02:17:58 | 00:05:14
2016-03-06 23:31:35 | 00:05:21
2016-03-07 04:27:12 | 00:05:20
2016-03-07 19:37:50 | 00:05:18
2016-03-07 21:08:44 | 00:05:20
2016-03-08 00:38:37 | 00:05:20
2016-03-08 01:51:46 | 00:05:17
2016-03-08 03:02:37 | 00:05:16
2016-03-08 13:31:29 | 00:05:18
2016-03-08 14:38:44 | 00:05:15
2016-03-08 16:08:41 | 00:05:18
2016-03-08 18:51:44 | 00:05:17
2016-03-08 19:59:06 | 00:05:19
2016-03-08 21:38:35 | 00:05:18
2016-03-09 02:40:11 | 00:05:18
2016-03-09 06:12:50 | 00:05:21
2016-03-09 07:28:43 | 00:05:18
2016-03-09 15:38:35 | 00:05:19
2016-03-09 16:48:44 | 00:05:17
2016-03-09 17:58:48 | 00:05:18
2016-03-09 19:18:42 | 00:05:17
2016-03-10 00:18:53 | 00:05:17
2016-03-10 04:41:04 | 00:05:19
2016-03-10 11:21:39 | 00:05:17
2016-03-10 12:28:33 | 00:05:17
2016-03-10 17:37:20 | 00:05:18
2016-03-10 19:01:42 | 00:05:19
2016-03-10 20:38:43 | 00:05:18
2016-03-10 21:48:56 | 00:05:16
2016-03-11 01:38:44 | 00:05:16
2016-03-11 02:58:43 | 00:05:17
2016-03-11 10:01:47 | 00:05:18
2016-03-11 11:48:43 | 00:05:17
2016-03-11 13:12:32 | 00:05:16
2016-03-11 14:21:59 | 00:05:18
2016-03-11 15:32:01 | 00:05:17
2016-03-11 16:38:49 | 00:05:17
2016-03-11 17:58:50 | 00:05:18
2016-03-12 17:21:50 | 00:05:18
2016-03-12 20:31:52 | 00:05:22
2016-03-12 21:38:54 | 00:05:22
2016-03-13 00:34:05 | 00:05:17
2016-03-13 03:41:54 | 00:05:23
2016-03-13 06:30:20 | 00:05:18
2016-03-13 12:21:53 | 00:05:17
2016-03-13 13:28:46 | 00:05:19
2016-03-13 20:31:36 | 00:05:17
2016-03-13 22:37:29 | 00:05:19
2016-03-14 14:51:58 | 00:05:18
2016-03-14 19:56:55 | 00:05:17
2016-03-14 21:22:12 | 00:05:20
2016-03-14 23:08:48 | 00:05:19
2016-03-15 00:18:56 | 00:05:16
2016-03-15 21:49:04 | 00:05:14
2016-03-16 01:42:11 | 00:05:17
2016-03-16 14:01:56 | 00:05:18
2016-03-16 15:08:54 | 00:05:22
2016-03-16 17:38:50 | 00:05:18
2016-03-16 18:48:51 | 00:05:19
2016-03-16 23:22:11 | 00:05:20
2016-03-17 00:58:04 | 00:05:20
2016-03-17 07:19:43 | 00:05:21
2016-03-17 11:28:06 | 00:05:20
2016-03-17 14:52:01 | 00:05:16
2016-03-17 21:52:17 | 00:05:20
2016-03-18 09:52:01 | 00:05:17
2016-03-18 13:52:06 | 00:05:17
2016-03-18 14:58:53 | 00:05:19
2016-03-18 16:08:57 | 00:05:20
2016-03-18 17:52:04 | 00:05:18
2016-03-18 18:59:03 | 00:05:20
2016-03-18 20:48:51 | 00:05:19
2016-03-18 22:58:04 | 00:05:19
2016-03-19 05:12:09 | 00:05:19
2016-03-19 06:18:52 | 00:05:18
2016-03-19 10:52:05 | 00:05:19
2016-03-19 15:08:45 | 00:05:19
2016-03-19 16:18:59 | 00:05:19
2016-03-19 18:38:05 | 00:05:20
2016-03-19 19:48:53 | 00:05:22
2016-03-21 02:12:04 | 00:05:23
2016-03-21 09:58:06 | 00:05:21
2016-03-21 11:47:56 | 00:05:18
2016-03-21 13:18:51 | 00:05:19
2016-03-21 14:28:59 | 00:05:21
2016-03-21 16:08:54 | 00:05:21
2016-03-21 22:42:09 | 00:05:18
2016-03-22 21:58:05 | 00:05:19
2016-03-23 12:49:55 | 00:05:22
2016-03-23 15:50:59 | 00:05:19
2016-03-23 18:00:15 | 00:05:22
2016-03-23 20:08:06 | 00:05:19
2016-03-24 00:32:17 | 00:05:20
2016-03-24 02:12:24 | 00:05:24
2016-03-24 03:58:53 | 00:05:22
2016-03-24 13:12:09 | 00:05:21
2016-03-24 19:58:06 | 00:05:20
2016-03-24 21:22:20 | 00:05:24
2016-03-24 22:28:54 | 00:05:21
2016-03-25 00:38:51 | 00:05:23
2016-03-25 01:48:55 | 00:05:22
2016-03-25 15:32:12 | 00:05:22
2016-03-25 16:42:20 | 00:05:19
2016-03-25 20:02:12 | 00:05:22
2016-03-25 21:08:57 | 00:05:24
2016-03-25 22:18:53 | 00:05:22
2016-03-26 03:16:49 | 00:05:22
2016-03-26 16:12:13 | 00:05:24
2016-03-26 23:59:45 | 00:05:22
2016-03-27 19:51:39 | 00:05:23
2016-03-27 22:07:27 | 00:05:24
2016-03-28 00:17:09 | 00:05:20
2016-03-28 05:12:11 | 00:05:19
2016-03-28 14:10:29 | 00:05:19
2016-03-28 16:25:53 | 00:05:22
2016-03-28 18:08:47 | 00:05:20
2016-03-28 19:18:53 | 00:05:21
2016-03-29 01:13:14 | 00:05:20
2016-03-29 02:38:55 | 00:05:21
2016-03-29 05:02:13 | 00:05:19
2016-03-29 14:52:16 | 00:05:20
2016-03-29 19:03:56 | 00:05:21
2016-03-29 21:52:15 | 00:05:22
2016-03-30 01:48:03 | 00:05:18
2016-03-30 03:08:56 | 00:05:21
2016-03-30 09:02:16 | 00:05:19
2016-03-30 15:38:08 | 00:05:20
2016-03-30 16:49:03 | 00:05:21
2016-03-30 18:08:56 | 00:05:21
2016-03-30 21:32:08 | 00:05:21
2016-03-30 22:58:58 | 00:05:23
2016-03-31 00:29:02 | 00:05:23
2016-03-31 02:12:16 | 00:05:22
2016-03-31 04:21:06 | 00:05:23
2016-03-31 19:02:24 | 00:05:21
2016-03-31 20:19:25 | 00:05:23
2016-04-01 09:42:14 | 00:05:20
2016-04-02 16:59:02 | 00:05:24
2016-04-02 18:08:59 | 00:05:23
2016-04-03 16:42:24 | 00:05:22
2016-04-03 17:58:57 | 00:05:21
2016-04-03 19:08:57 | 00:05:22
2016-04-03 20:18:56 | 00:05:23
2016-04-03 21:38:08 | 00:05:20
2016-04-04 06:32:25 | 00:05:19
2016-04-04 12:06:39 | 00:05:21
2016-04-04 19:12:52 | 00:05:23
2016-04-04 21:13:03 | 00:05:23
2016-04-05 00:17:50 | 00:05:23
2016-04-05 01:32:35 | 00:05:23
2016-04-05 09:12:12 | 00:05:21
2016-04-05 18:22:28 | 00:05:22
2016-04-05 19:49:06 | 00:05:22
2016-04-05 21:29:00 | 00:05:24
2016-04-05 22:54:18 | 00:05:21
2016-04-06 08:32:30 | 00:05:21
2016-04-06 09:49:06 | 00:05:21
2016-04-06 13:12:14 | 00:05:21
2016-04-06 14:28:57 | 00:05:24
2016-04-06 15:42:40 | 00:05:24
2016-04-06 17:29:03 | 00:05:22
2016-04-07 01:52:34 | 00:05:23
2016-04-07 03:22:31 | 00:05:22
2016-04-07 04:48:59 | 00:05:24
2016-04-07 11:22:27 | 00:05:19
2016-04-07 16:09:01 | 00:05:24
2016-04-07 17:39:04 | 00:05:25
2016-04-07 18:58:58 | 00:05:23
2016-04-08 02:02:29 | 00:05:22
2016-04-08 06:08:08 | 00:05:23
2016-04-08 07:59:05 | 00:05:25
2016-04-08 09:39:00 | 00:05:25
2016-04-08 15:02:32 | 00:05:22
2016-04-09 21:08:45 | 00:05:24
2016-04-09 23:42:16 | 00:05:26
2016-04-10 04:32:18 | 00:05:24
2016-04-10 14:07:58 | 00:05:25
2016-04-10 17:22:16 | 00:05:26
2016-04-12 01:51:10 | 00:05:28
2016-04-12 12:52:27 | 00:05:29
2016-04-12 15:02:37 | 00:05:31
2016-04-12 16:19:08 | 00:05:29
2016-04-12 17:39:06 | 00:05:29
2016-04-12 19:32:40 | 00:05:26
2016-04-12 20:49:03 | 00:05:29
2016-04-13 00:02:42 | 00:05:29
2016-04-13 11:58:17 | 00:05:30
2016-04-13 21:18:16 | 00:05:28
2016-04-13 22:39:07 | 00:05:29
2016-04-14 04:27:38 | 00:05:27
2016-04-14 13:49:15 | 00:05:27
2016-04-14 17:32:47 | 00:05:29
2016-04-14 18:49:06 | 00:05:31
2016-04-15 01:43:55 | 00:05:28
2016-04-15 07:08:24 | 00:05:27
2016-04-15 08:59:08 | 00:05:28
2016-04-15 11:52:24 | 00:05:30
2016-04-15 14:49:19 | 00:05:28
2016-04-15 18:14:06 | 00:05:29
2016-04-16 00:32:52 | 00:05:29
2016-04-16 02:09:03 | 00:05:31
2016-04-16 16:19:21 | 00:05:28
2016-04-17 00:02:55 | 00:05:28
2016-04-17 15:52:56 | 00:05:28
2016-04-18 21:15:32 | 00:05:29
2016-04-18 23:35:20 | 00:05:29
2016-04-19 20:48:23 | 00:05:28
2016-04-20 13:53:10 | 00:05:29
2016-04-20 20:23:50 | 00:05:29
2016-04-20 22:02:56 | 00:05:30
2016-04-21 03:08:23 | 00:05:31
2016-04-21 08:21:03 | 00:05:28
2016-04-21 13:48:23 | 00:05:29
2016-04-21 15:19:16 | 00:05:30
2016-04-21 17:03:00 | 00:05:28
2016-04-21 18:19:21 | 00:05:28
2016-04-21 23:42:43 | 00:05:28
2016-04-22 04:58:30 | 00:05:28
2016-04-22 12:14:07 | 00:05:30
2016-04-22 17:01:54 | 00:05:29
2016-04-23 14:53:04 | 00:05:29
2016-04-24 00:51:25 | 00:05:30
2016-04-24 19:28:17 | 00:05:28
2016-04-24 20:49:12 | 00:05:28
2016-04-25 01:04:37 | 00:05:26
2016-04-25 16:39:05 | 00:05:30
2016-04-25 19:32:56 | 00:05:30
2016-04-25 21:02:57 | 00:05:28
2016-04-25 22:19:13 | 00:05:28
2016-04-26 08:52:56 | 00:05:29
2016-04-26 12:38:18 | 00:05:28
2016-04-26 15:33:02 | 00:05:29
2016-04-26 16:53:07 | 00:05:28
2016-04-26 23:02:58 | 00:05:29
2016-04-27 01:38:18 | 00:05:27
2016-04-27 04:02:05 | 00:05:27
2016-04-27 11:49:38 | 00:05:31
2016-04-27 14:58:20 | 00:05:29
2016-04-27 16:19:20 | 00:05:30
2016-04-27 18:02:58 | 00:05:28
2016-04-27 20:47:58 | 00:05:16
2016-04-27 22:00:53 | 00:05:23
2016-04-27 23:17:47 | 00:05:18
2016-04-28 14:12:49 | 00:05:18
2016-04-28 20:24:24 | 00:05:18
2016-04-29 07:04:57 | 00:05:19
2016-04-29 13:16:40 | 00:05:18
2016-04-29 15:23:10 | 00:05:18
2016-04-29 19:26:02 | 00:05:21
2016-04-29 22:07:35 | 00:05:24
2016-04-30 03:41:23 | 00:05:20
2016-04-30 15:00:39 | 00:05:18
2016-04-30 16:37:32 | 00:05:18
2016-04-30 18:20:52 | 00:05:18
2016-05-01 15:37:32 | 00:05:18
2016-05-02 11:07:32 | 00:05:23
2016-05-02 13:30:41 | 00:05:20
2016-05-02 14:48:00 | 00:05:19
2016-05-02 19:50:57 | 00:05:20
2016-05-02 21:46:57 | 00:05:17
2016-05-03 14:47:40 | 00:05:17
2016-05-03 15:57:53 | 00:05:18
2016-05-03 18:46:58 | 00:05:20
2016-05-04 09:07:32 | 00:05:19
2016-05-04 15:07:29 | 00:05:19
2016-05-04 21:00:44 | 00:05:18
2016-05-05 10:30:55 | 00:05:19
2016-05-05 19:00:58 | 00:05:18
2016-05-05 23:50:58 | 00:05:21
2016-05-06 04:45:29 | 00:05:20
2016-05-06 12:00:56 | 00:05:20
2016-05-06 13:17:55 | 00:05:22
2016-05-06 15:20:57 | 00:05:19
2016-05-06 20:16:48 | 00:05:22
2016-05-06 21:27:55 | 00:05:21
2016-05-07 01:20:57 | 00:05:21
2016-05-07 04:57:40 | 00:05:20
2016-05-07 20:57:50 | 00:05:21
2016-05-08 05:51:03 | 00:05:21
2016-05-08 16:21:02 | 00:05:20
2016-05-08 17:27:53 | 00:05:22
2016-05-09 15:48:05 | 00:05:21
2016-05-10 00:51:21 | 00:05:18
2016-05-10 23:57:36 | 00:05:21
2016-05-11 21:27:38 | 00:05:19
2016-05-12 21:20:44 | 00:05:23
2016-05-13 01:55:12 | 00:05:20
2016-05-14 01:51:17 | 00:05:21
2016-05-15 21:10:06 | 00:05:22
2016-05-16 15:30:05 | 00:05:21
2016-05-16 16:39:02 | 00:05:21
2016-05-16 21:10:17 | 00:05:19
2016-05-17 19:20:06 | 00:05:21
2016-05-17 21:10:11 | 00:05:20
2016-05-19 18:50:18 | 00:05:18
2016-05-22 02:30:20 | 00:05:21
2016-05-23 18:17:09 | 00:05:19
2016-05-23 23:52:08 | 00:05:21
2016-05-24 02:13:30 | 00:05:20
2016-05-24 19:07:33 | 00:05:21
2016-05-24 23:54:30 | 00:05:19
2016-05-25 01:10:57 | 00:05:21
2016-05-25 03:00:16 | 00:05:22
2016-05-25 04:27:56 | 00:05:21
2016-05-25 19:17:50 | 00:05:22
2016-05-26 00:27:56 | 00:05:21
2016-05-26 17:29:15 | 00:05:23
2016-05-26 20:09:58 | 00:05:20
2016-05-26 22:14:40 | 00:05:19
2016-05-27 17:21:07 | 00:05:17
2016-05-28 20:37:41 | 00:05:21
2016-05-29 19:38:45 | 00:05:20
2016-05-30 20:19:26 | 00:05:22
2016-05-30 22:50:26 | 00:05:22
2016-05-31 04:10:25 | 00:05:19
2016-05-31 20:59:52 | 00:05:20
2016-06-01 22:03:07 | 00:05:20
2016-06-02 18:26:08 | 00:05:20
2016-06-02 22:06:13 | 00:05:21
2016-06-03 14:10:32 | 00:05:22
2016-06-03 15:18:20 | 00:05:19
2016-06-03 18:58:31 | 00:05:22
2016-06-03 21:32:31 | 00:05:19
2016-06-04 00:04:03 | 00:05:19
2016-06-04 05:00:31 | 00:05:20
2016-06-05 16:56:32 | 00:05:20
2016-06-05 21:10:26 | 00:05:19
2016-06-06 12:00:30 | 00:05:20
2016-06-06 13:08:04 | 00:05:21
2016-06-06 14:20:46 | 00:05:21
2016-06-06 19:00:31 | 00:05:20
2016-06-06 20:08:06 | 00:05:21
2016-06-06 23:40:48 | 00:05:19
2016-06-07 13:50:33 | 00:05:22
2016-06-07 14:58:08 | 00:05:21
2016-06-07 16:08:09 | 00:05:24
2016-06-07 17:18:02 | 00:05:23
2016-06-07 18:30:47 | 00:05:19
2016-06-07 21:30:34 | 00:05:21
2016-06-08 02:55:52 | 00:05:20
2016-06-08 04:08:06 | 00:05:22
2016-06-09 14:10:40 | 00:05:21
2016-06-09 15:38:06 | 00:05:22
2016-06-09 20:40:24 | 00:05:22
2016-06-09 22:42:12 | 00:05:22
2016-06-10 00:30:49 | 00:05:21
2016-06-10 14:40:29 | 00:05:20
2016-06-10 15:58:05 | 00:05:20
2016-06-10 17:08:02 | 00:05:20
2016-06-10 20:10:38 | 00:05:19
2016-06-10 21:28:02 | 00:05:21
2016-06-10 22:50:47 | 00:05:23
2016-06-11 23:37:40 | 00:05:21
2016-06-12 08:30:32 | 00:05:23
2016-06-13 16:57:07 | 00:05:21
2016-06-13 21:48:47 | 00:05:21
2016-06-14 13:10:36 | 00:05:23
2016-06-14 16:08:13 | 00:05:25
2016-06-14 18:00:31 | 00:05:21
2016-06-14 19:08:06 | 00:05:23
2016-06-14 20:18:04 | 00:05:22
2016-06-15 14:40:34 | 00:05:21
2016-06-15 15:51:17 | 00:05:21
2016-06-15 18:40:33 | 00:05:23
2016-06-15 19:48:08 | 00:05:22
2016-06-16 02:10:38 | 00:05:22
2016-06-17 12:50:43 | 00:05:25
2016-06-17 13:58:04 | 00:05:22
2016-06-17 17:10:42 | 00:05:21
2016-06-17 19:50:44 | 00:05:22
2016-06-17 20:58:10 | 00:05:21
2016-06-18 01:07:51 | 00:05:21
2016-06-18 02:18:09 | 00:05:22
2016-06-18 03:58:06 | 00:05:23
2016-06-18 05:08:07 | 00:05:22
2016-06-18 19:30:45 | 00:05:24
2016-06-18 23:50:46 | 00:05:23
2016-06-20 15:00:48 | 00:05:25
2016-06-20 16:08:08 | 00:05:23
2016-06-20 21:36:19 | 00:05:25
2016-06-21 22:50:45 | 00:05:23
2016-06-22 00:37:47 | 00:05:22
2016-06-22 02:07:23 | 00:05:23
2016-06-22 15:57:21 | 00:05:23
2016-06-22 21:00:29 | 00:05:22
2016-06-22 22:20:28 | 00:05:21
2016-06-23 14:57:22 | 00:05:24
2016-06-23 21:16:41 | 00:05:20
2016-06-24 05:20:29 | 00:05:23
2016-06-24 18:50:30 | 00:05:22
2016-06-24 19:59:41 | 00:05:23
2016-06-24 22:06:01 | 00:05:23
2016-06-25 02:24:27 | 00:05:23
2016-06-26 16:20:29 | 00:05:24
2016-06-26 18:40:39 | 00:05:23
2016-06-26 20:29:04 | 00:05:22
2016-06-27 17:53:43 | 00:05:21
2016-06-27 19:08:33 | 00:05:24
2016-06-27 23:05:44 | 00:05:22
2016-06-28 14:50:35 | 00:05:22
2016-06-28 20:10:32 | 00:05:20
2016-06-29 17:20:32 | 00:05:23
2016-06-30 05:59:17 | 00:05:23
2016-06-30 18:35:33 | 00:05:22
2016-06-30 22:47:25 | 00:05:23
2016-07-01 14:06:28 | 00:05:23
2016-07-01 15:18:15 | 00:05:24
2016-07-01 18:57:00 | 00:05:24
2016-07-01 20:18:17 | 00:05:23
2016-07-01 21:40:40 | 00:05:23
2016-07-02 00:07:25 | 00:05:23
2016-07-02 17:30:38 | 00:05:21
2016-07-03 03:07:51 | 00:05:24
2016-07-03 19:00:32 | 00:05:23
2016-07-03 20:08:17 | 00:05:24
2016-07-03 21:18:19 | 00:05:25
2016-07-03 22:31:03 | 00:05:23
2016-07-03 23:38:18 | 00:05:22
2016-07-04 21:16:31 | 00:05:23
2016-07-06 10:10:42 | 00:05:24
2016-07-07 01:29:55 | 00:05:23
2016-07-07 04:07:55 | 00:05:22
2016-07-07 15:40:50 | 00:05:22
2016-07-07 23:18:22 | 00:05:24
2016-07-08 16:10:38 | 00:05:29
2016-07-08 20:50:37 | 00:05:31
2016-07-09 19:10:37 | 00:05:31
2016-07-09 22:44:58 | 00:05:30
2016-07-10 16:47:25 | 00:05:25
2016-07-11 11:00:43 | 00:08:20
2016-07-11 14:48:43 | 00:05:24
2016-07-11 17:56:36 | 00:05:24
2016-07-11 22:20:42 | 00:05:21
2016-07-12 23:16:56 | 00:05:22
2016-07-13 19:30:48 | 00:05:27
2016-07-13 20:38:18 | 00:05:25
2016-07-14 13:50:45 | 00:05:27
2016-07-14 22:47:26 | 00:05:31
2016-07-15 04:23:43 | 00:05:31
2016-07-15 16:30:46 | 00:05:32
2016-07-15 17:38:22 | 00:05:31
2016-07-15 21:16:38 | 00:05:33
2016-07-16 00:57:08 | 00:05:32
2016-07-16 06:08:10 | 00:05:30
2016-07-16 17:00:47 | 00:05:29
2016-07-16 22:31:25 | 00:05:30
2016-07-17 13:10:41 | 00:05:32
2016-07-17 17:56:34 | 00:05:31
2016-07-17 22:50:58 | 00:05:30
2016-07-17 23:58:18 | 00:05:30
2016-07-18 09:30:42 | 00:05:30
2016-07-18 17:00:50 | 00:05:33
2016-07-18 21:02:57 | 00:05:31
2016-07-19 23:53:58 | 00:05:29
2016-07-21 16:00:40 | 00:05:33
2016-07-21 18:17:22 | 00:05:31
2016-07-21 23:08:05 | 00:05:32
2016-07-22 15:40:59 | 00:05:30
2016-07-22 20:47:41 | 00:05:32
2016-07-24 00:30:57 | 00:05:31
2016-07-24 05:17:08 | 00:05:32
2016-07-25 05:50:55 | 00:05:30
2016-07-25 09:00:57 | 00:05:31
2016-07-26 02:20:56 | 00:05:31
2016-07-26 12:30:55 | 00:05:32
2016-07-26 20:28:17 | 00:05:32
2016-07-27 01:40:46 | 00:05:31
2016-07-27 14:30:52 | 00:05:34
2016-07-27 21:50:52 | 00:05:31
2016-07-28 06:20:52 | 00:05:34
2016-07-28 19:31:36 | 00:05:29
2016-07-29 02:15:24 | 00:05:32
2016-07-29 16:20:57 | 00:05:31
2016-07-29 18:25:16 | 00:05:31
2016-07-29 23:40:56 | 00:05:31
2016-07-31 15:08:05 | 00:05:32
2016-07-31 20:10:58 | 00:05:34
2016-08-01 12:38:54 | 00:05:31
2016-08-01 17:27:32 | 00:05:32
2016-08-01 18:38:29 | 00:05:31
2016-08-01 21:53:15 | 00:05:31
2016-08-02 16:51:28 | 00:05:32
2016-08-02 21:18:09 | 00:05:33
2016-08-02 23:24:32 | 00:05:31
2016-08-03 02:37:38 | 00:05:30
2016-08-03 14:41:08 | 00:05:31
2016-08-03 17:27:36 | 00:05:31
2016-08-03 18:54:14 | 00:05:31
2016-08-03 20:51:10 | 00:05:31
2016-08-03 22:08:35 | 00:05:31
2016-08-04 20:07:38 | 00:05:30
2016-08-05 03:21:16 | 00:05:30
2016-08-05 20:51:07 | 00:05:31
2016-08-06 02:48:03 | 00:05:34
2016-08-06 20:24:06 | 00:05:31
2016-08-07 17:17:37 | 00:05:31
2016-08-07 20:13:35 | 00:05:31
2016-08-07 21:47:39 | 00:05:31
2016-08-08 02:56:00 | 00:05:35
2016-08-08 12:17:36 | 00:05:32
2016-08-08 18:19:16 | 00:05:31
2016-08-08 23:54:19 | 00:05:31
2016-08-10 03:03:53 | 00:05:30
2016-08-11 18:04:05 | 00:05:33
2016-08-12 12:58:31 | 00:05:34
2016-08-12 19:31:28 | 00:05:29
2016-08-12 22:50:47 | 00:05:30
2016-08-13 22:40:56 | 00:05:34
2016-08-14 02:30:43 | 00:05:32
2016-08-14 19:07:37 | 00:05:34
2016-08-15 16:00:42 | 00:05:32
2016-08-15 17:50:58 | 00:05:31
2016-08-15 21:20:49 | 00:05:31
2016-08-15 22:31:06 | 00:05:33
2016-08-16 17:01:10 | 00:05:33
2016-08-16 19:09:15 | 00:05:33
2016-08-16 23:58:25 | 00:05:33
2016-08-17 01:09:54 | 00:05:35
2016-08-17 09:51:34 | 00:05:31
2016-08-17 19:01:14 | 00:05:34
2016-08-18 01:13:41 | 00:05:35
2016-08-18 10:38:46 | 00:05:35
2016-08-18 12:59:29 | 00:05:34
2016-08-18 21:08:17 | 00:05:37
2016-08-19 01:41:08 | 00:05:34
2016-08-19 17:01:15 | 00:05:32
2016-08-19 21:07:34 | 00:05:33
2016-08-19 22:30:31 | 00:05:33
2016-08-20 19:11:05 | 00:05:31
2016-08-20 21:01:17 | 00:05:32
2016-08-22 02:21:02 | 00:05:32
2016-08-22 12:11:04 | 00:05:33
2016-08-22 15:51:07 | 00:05:32
2016-08-22 21:38:59 | 00:05:34
2016-08-23 13:51:18 | 00:05:30
2016-08-23 15:11:12 | 00:05:31
2016-08-23 16:40:29 | 00:05:31
2016-08-23 17:52:13 | 00:05:31
2016-08-23 19:10:32 | 00:05:33
2016-08-23 20:32:06 | 00:05:31
2016-08-24 04:31:26 | 00:05:31
2016-08-24 19:42:46 | 00:05:31
2016-08-25 03:36:06 | 00:05:39
2016-08-25 18:51:29 | 00:05:31
2016-08-26 13:41:07 | 00:05:35
2016-08-26 15:59:06 | 00:05:35
2016-08-26 20:30:02 | 00:05:32
2016-08-27 23:10:15 | 00:05:37
2016-08-28 22:52:07 | 00:05:35
2016-08-29 10:33:27 | 00:05:32
2016-08-29 12:59:34 | 00:05:35
2016-08-29 14:19:15 | 00:05:35
2016-08-29 23:04:53 | 00:05:34
2016-08-30 20:30:45 | 00:05:37
2016-08-30 21:39:18 | 00:05:36
2016-08-30 23:39:17 | 00:05:38
2016-08-31 08:38:22 | 00:05:38
2016-08-31 18:14:45 | 00:05:36
2016-08-31 21:28:15 | 00:05:35
2016-09-01 00:01:00 | 00:05:36
2016-09-01 14:20:58 | 00:05:36
2016-09-01 21:20:57 | 00:05:37
2016-09-02 05:50:59 | 00:05:36
2016-09-02 09:01:00 | 00:05:33
2016-09-02 11:01:04 | 00:07:03
2016-09-03 02:25:53 | 00:05:41
2016-09-03 17:00:53 | 00:05:41
2016-09-03 21:17:38 | 00:05:41
2016-09-04 12:10:53 | 00:05:40
2016-09-04 16:40:45 | 00:05:41
2016-09-05 04:06:29 | 00:05:45
2016-09-05 09:01:08 | 00:05:40
2016-09-05 10:09:19 | 00:05:42
2016-09-05 17:13:47 | 00:05:43
2016-09-05 21:08:17 | 00:05:38
2016-09-05 22:29:20 | 00:05:39
2016-09-05 23:39:19 | 00:05:38
2016-09-06 04:11:11 | 00:05:39
2016-09-06 14:51:01 | 00:05:38
2016-09-06 17:31:08 | 00:05:39
2016-09-06 19:01:14 | 00:05:38
2016-09-06 21:11:58 | 00:05:41
2016-09-07 04:01:07 | 00:05:43
2016-09-07 20:21:04 | 00:05:40
2016-09-08 05:51:03 | 00:05:40
2016-09-08 10:21:04 | 00:05:39
2016-09-08 17:00:08 | 00:05:38
2016-09-08 19:10:03 | 00:05:40
2016-09-09 03:35:48 | 00:05:40
2016-09-09 16:54:55 | 00:05:40
2016-09-09 21:40:00 | 00:05:40
2016-09-10 00:24:38 | 00:05:43
2016-09-10 20:49:31 | 00:05:41
2016-09-11 03:45:01 | 00:05:41
2016-09-11 13:28:24 | 00:05:40
2016-09-11 16:48:21 | 00:05:39
2016-09-11 18:21:08 | 00:05:40
2016-09-11 20:51:09 | 00:05:39
2016-09-11 23:39:33 | 00:05:43
2016-09-12 10:57:38 | 00:10:54
2016-09-12 14:41:06 | 00:05:40
2016-09-12 19:31:14 | 00:05:38
2016-09-13 01:21:14 | 00:05:40
2016-09-13 02:51:13 | 00:05:41
2016-09-13 13:31:17 | 00:05:40
2016-09-13 18:01:18 | 00:05:43
2016-09-13 19:39:30 | 00:05:42
2016-09-13 21:18:23 | 00:05:41
2016-09-14 18:41:12 | 00:05:39
2016-09-14 19:59:27 | 00:05:40
2016-09-15 00:01:15 | 00:05:38
2016-09-15 10:01:23 | 00:05:39
2016-09-15 14:01:36 | 00:05:48
2016-09-15 18:09:21 | 00:05:45
2016-09-15 22:24:18 | 00:05:42
2016-09-16 13:41:16 | 00:05:43
2016-09-18 16:14:25 | 00:05:39
2016-09-19 18:28:27 | 00:05:41
2016-09-19 22:39:44 | 00:05:41
2016-09-20 10:50:12 | 00:06:06
2016-09-20 19:13:22 | 00:05:43
2016-09-21 11:34:22 | 00:05:41
2016-09-21 15:40:24 | 00:05:40
2016-09-22 13:09:51 | 00:05:44
2016-09-22 20:37:37 | 00:05:41
2016-09-22 22:21:33 | 00:05:40
2016-09-23 05:11:11 | 00:05:42
2016-09-23 11:33:17 | 00:05:42
2016-09-23 13:21:09 | 00:05:40
2016-09-23 22:22:07 | 00:05:41
2016-09-25 19:51:28 | 00:05:41
2016-09-26 08:01:20 | 00:05:42
2016-09-26 19:01:17 | 00:05:42
2016-09-27 00:31:05 | 00:05:41
2016-09-27 05:13:13 | 00:05:44
2016-09-27 15:51:10 | 00:05:40
2016-09-27 17:31:00 | 00:05:39
2016-09-27 18:51:31 | 00:05:40
2016-09-27 22:51:02 | 00:05:37
2016-09-28 09:31:13 | 00:05:40
2016-09-28 15:28:24 | 00:05:40
2016-09-28 20:29:27 | 00:05:41
2016-09-28 21:41:35 | 00:05:40
2016-09-29 00:58:05 | 00:05:42
2016-09-29 10:18:29 | 00:05:40
2016-09-29 15:41:10 | 00:05:39
2016-09-29 17:41:12 | 00:05:38
2016-09-30 02:21:14 | 00:05:41
2016-09-30 13:20:06 | 00:05:39
2016-10-01 00:26:51 | 00:05:42
2016-10-01 05:41:01 | 00:05:40
2016-10-01 18:41:43 | 00:05:40
2016-10-01 20:59:49 | 00:05:40
2016-10-02 01:42:36 | 00:05:44
2016-10-02 16:41:25 | 00:05:40
2016-10-02 19:43:48 | 00:05:44
2016-10-03 10:51:25 | 00:06:48
2016-10-03 16:19:39 | 00:05:39
2016-10-03 22:34:45 | 00:05:43
2016-10-04 02:28:33 | 00:05:40
2016-10-04 15:59:39 | 00:05:44
2016-10-04 17:19:59 | 00:05:40
2016-10-04 19:31:26 | 00:05:41
2016-10-04 20:51:47 | 00:05:41
2016-10-04 22:09:39 | 00:05:39
2016-10-05 12:32:20 | 00:05:40
2016-10-05 15:51:26 | 00:05:39
2016-10-05 18:22:18 | 00:05:42
2016-10-06 02:48:33 | 00:05:41
2016-10-06 04:09:38 | 00:05:45
2016-10-06 07:01:23 | 00:05:43
2016-10-06 12:49:33 | 00:05:41
2016-10-07 13:18:48 | 00:05:42
2016-10-07 18:29:26 | 00:05:41
2016-10-07 22:41:36 | 00:05:42
2016-10-08 01:38:02 | 00:05:45
2016-10-09 03:14:51 | 00:05:42
2016-10-09 18:03:08 | 00:05:38
2016-10-09 22:11:32 | 00:05:41
2016-10-10 02:01:29 | 00:05:40
2016-10-10 09:31:32 | 00:05:41
2016-10-10 15:44:18 | 00:05:42
2016-10-10 20:50:07 | 00:05:42
2016-10-11 15:31:44 | 00:05:41
2016-10-11 16:59:46 | 00:05:44
2016-10-12 03:38:45 | 00:05:41
2016-10-12 09:11:40 | 00:05:43
2016-10-12 16:31:31 | 00:05:41
2016-10-12 22:14:04 | 00:05:45
2016-10-13 04:33:40 | 00:05:41
2016-10-13 14:51:45 | 00:05:42
2016-10-13 21:05:20 | 00:05:43
2016-10-14 02:47:30 | 00:05:42
2016-10-15 01:37:57 | 00:05:42
2016-10-17 09:01:48 | 00:05:43
2016-10-17 12:09:06 | 00:05:44
2016-10-17 14:39:21 | 00:05:41
2016-10-17 21:01:40 | 00:05:41
2016-10-18 13:39:28 | 00:05:40
2016-10-18 18:34:25 | 00:05:45
2016-10-18 22:39:39 | 00:06:57
2016-10-19 11:47:44 | 00:06:53
2016-10-19 16:50:56 | 00:06:54
2016-10-19 23:04:46 | 00:06:52
2016-10-20 05:23:07 | 00:06:54
2016-10-20 14:41:43 | 00:06:55
2016-10-20 16:00:00 | 00:06:55
2016-10-21 00:28:43 | 00:06:53
2016-10-21 15:51:58 | 00:06:54
2016-10-21 17:09:54 | 00:06:56
2016-10-23 13:39:31 | 00:06:57
2016-10-23 14:59:54 | 00:06:55
2016-10-23 16:22:19 | 00:06:52
2016-10-24 00:03:03 | 00:06:55
2016-10-24 14:44:15 | 00:06:55
2016-10-24 20:01:57 | 00:06:57
2016-10-25 03:16:29 | 00:06:54
2016-10-25 15:32:00 | 00:06:56
2016-10-25 17:11:59 | 00:06:53
2016-10-25 21:11:50 | 00:06:56
2016-10-26 14:25:06 | 00:06:57
2016-10-26 22:15:30 | 00:06:56
2016-10-27 01:32:50 | 00:06:54
2016-10-27 02:52:18 | 00:06:53
2016-10-27 19:57:40 | 00:06:54
2016-10-28 01:40:08 | 00:06:55
2016-10-28 13:21:15 | 00:06:57
2016-10-28 16:31:22 | 00:06:56
2016-10-30 13:20:53 | 00:07:02
2016-10-30 16:28:15 | 00:06:58
2016-10-30 19:50:08 | 00:06:58
2016-10-31 01:38:39 | 00:06:57
2016-10-31 13:30:43 | 00:06:59
2016-11-01 16:08:58 | 00:06:57
2016-11-02 12:50:59 | 00:06:59
2016-11-02 19:42:29 | 00:06:56
2016-11-02 22:11:04 | 00:06:58
2016-11-03 13:51:07 | 00:06:57
2016-11-03 15:38:56 | 00:06:55
2016-11-03 16:59:21 | 00:06:58
2016-11-03 18:21:25 | 00:06:56
2016-11-04 02:30:57 | 00:06:59
2016-11-04 13:10:53 | 00:06:58
2016-11-04 14:29:30 | 00:06:57
2016-11-04 20:22:59 | 00:06:59
2016-11-04 22:40:53 | 00:06:56
2016-11-04 23:59:27 | 00:06:59
2016-11-05 15:19:04 | 00:06:56
2016-11-05 19:12:15 | 00:06:57
2016-11-06 02:20:48 | 00:06:57
2016-11-06 16:54:16 | 00:06:58
2016-11-06 22:41:04 | 00:06:59
2016-11-07 02:26:24 | 00:06:56
2016-11-07 17:13:04 | 00:07:00
2016-11-08 02:43:01 | 00:06:59
2016-11-08 16:01:10 | 00:06:57
2016-11-08 17:29:28 | 00:06:58
2016-11-08 18:51:31 | 00:06:57
2016-11-08 20:43:19 | 00:06:57
2016-11-08 22:19:28 | 00:06:58
2016-11-08 23:39:32 | 00:06:59
2016-11-09 21:41:04 | 00:07:00
2016-11-10 17:43:17 | 00:07:00
2016-11-10 19:20:57 | 00:07:02
2016-11-10 23:12:18 | 00:06:57
2016-11-12 13:11:01 | 00:06:57
2016-11-13 13:31:08 | 00:06:58
2016-11-14 03:01:04 | 00:06:57
2016-11-14 15:11:08 | 00:06:59
2016-11-14 18:43:35 | 00:07:00
2016-11-14 23:01:10 | 00:06:59
2016-11-15 14:19:03 | 00:06:59
2016-11-15 15:39:27 | 00:06:57
2016-11-15 16:59:30 | 00:06:58
2016-11-15 23:29:46 | 00:06:54
2016-11-17 19:37:53 | 00:06:55
2016-11-17 23:53:21 | 00:07:00
2016-11-18 19:31:14 | 00:06:58
2016-11-18 20:49:31 | 00:06:57
2016-11-19 20:34:23 | 00:07:02
2016-11-20 20:34:38 | 00:06:59
2016-11-21 17:23:34 | 00:07:01
2016-11-21 18:49:33 | 00:06:58
2016-11-22 03:51:45 | 00:06:55
2016-11-22 19:39:04 | 00:06:55
2016-11-22 21:09:32 | 00:06:56
2016-11-23 01:39:04 | 00:06:56
2016-11-23 19:54:48 | 00:06:59
2016-11-24 00:36:04 | 00:06:57
2016-11-24 20:54:11 | 00:06:57
2016-11-25 13:21:17 | 00:06:58
2016-11-25 20:54:40 | 00:06:57
2016-11-26 02:00:45 | 00:06:56
2016-11-26 15:41:07 | 00:06:57
2016-11-26 23:00:55 | 00:06:56
2016-11-28 02:31:14 | 00:06:57
2016-11-28 18:04:56 | 00:06:58
2016-11-28 20:31:47 | 00:06:56
2016-11-29 00:21:25 | 00:07:00
2016-11-29 16:08:32 | 00:06:58
2016-11-29 18:41:49 | 00:06:56
2016-11-29 20:14:03 | 00:06:58
2016-11-29 23:11:13 | 00:06:59
2016-11-30 01:43:51 | 00:06:58
2016-11-30 11:11:22 | 00:06:57
2016-11-30 13:02:08 | 00:07:00
2016-11-30 16:21:20 | 00:07:00
2016-11-30 20:51:30 | 00:06:52
2016-12-01 00:31:26 | 00:06:52
2016-12-01 02:09:34 | 00:06:56
2016-12-01 20:18:35 | 00:06:51
2016-12-01 22:51:20 | 00:06:58
2016-12-02 01:39:09 | 00:06:53
2016-12-02 07:16:56 | 00:06:57
2016-12-02 12:51:58 | 00:06:54
2016-12-02 14:39:35 | 00:06:51
2016-12-02 16:38:36 | 00:06:54
2016-12-02 22:39:33 | 00:06:55
2016-12-03 23:57:27 | 00:06:51
2016-12-04 05:31:30 | 00:06:56
2016-12-04 22:14:35 | 00:06:54
2016-12-05 13:52:29 | 00:06:57
2016-12-05 15:59:33 | 00:06:57
2016-12-05 17:29:32 | 00:06:55
2016-12-05 19:21:21 | 00:06:55
2016-12-05 20:49:32 | 00:06:57
2016-12-05 23:12:13 | 00:06:58
2016-12-06 01:28:33 | 00:06:56
2016-12-06 15:21:23 | 00:06:56
2016-12-06 18:56:17 | 00:06:53
2016-12-07 00:41:18 | 00:06:57
2016-12-07 03:12:21 | 00:06:58
2016-12-07 04:39:33 | 00:06:57
2016-12-07 06:51:25 | 00:06:56
2016-12-07 08:19:52 | 00:06:56
2016-12-07 22:05:16 | 00:07:00
2016-12-08 08:31:20 | 00:07:02
2016-12-08 11:51:36 | 00:14:01
2016-12-08 13:19:37 | 00:07:03
2016-12-08 16:51:30 | 00:07:03
2016-12-08 21:46:17 | 00:07:01
2016-12-09 17:51:37 | 00:07:02
2016-12-09 23:39:57 | 00:07:03
2016-12-11 22:44:28 | 00:07:02
2016-12-12 07:39:04 | 00:07:02
2016-12-12 08:59:34 | 00:07:01
2016-12-12 10:19:34 | 00:07:02
2016-12-12 11:39:34 | 00:07:03
2016-12-12 19:50:04 | 00:07:02
2016-12-12 21:19:35 | 00:07:01
2016-12-13 16:02:06 | 00:07:03
2016-12-13 17:29:35 | 00:07:02
2016-12-13 19:52:13 | 00:07:03
2016-12-13 21:41:30 | 00:07:04
2016-12-15 14:01:40 | 00:07:05
2016-12-15 15:51:51 | 00:07:03
2016-12-15 21:45:24 | 00:07:00
2016-12-16 15:40:01 | 00:07:03
2016-12-16 18:23:18 | 00:07:02
2016-12-16 21:11:12 | 00:07:01
2016-12-17 13:41:42 | 00:07:00
2016-12-17 21:41:51 | 00:07:02
2016-12-18 05:34:33 | 00:07:02
2016-12-18 23:21:55 | 00:07:02
2016-12-19 10:25:17 | 00:07:01
2016-12-19 13:50:46 | 00:07:02
2016-12-19 16:41:53 | 00:07:03
2016-12-19 18:09:50 | 00:07:02
2016-12-19 20:42:38 | 00:07:01
2016-12-19 22:21:48 | 00:07:00
2016-12-20 04:01:57 | 00:07:04
2016-12-20 08:34:46 | 00:07:02
2016-12-20 13:51:59 | 00:07:00
2016-12-21 00:01:59 | 00:07:02
2016-12-21 01:29:48 | 00:07:03
2016-12-21 11:31:56 | 00:07:02
2016-12-21 14:21:48 | 00:07:03
2016-12-21 15:49:49 | 00:07:02
2016-12-21 18:22:25 | 00:07:03
2016-12-22 00:38:11 | 00:07:03
2016-12-22 08:46:09 | 00:07:01
2016-12-22 19:30:14 | 00:07:00
2016-12-23 01:55:25 | 00:07:05
2016-12-23 12:35:11 | 00:07:01
2016-12-23 14:10:02 | 00:07:04
2016-12-23 16:09:58 | 00:07:03
2016-12-23 17:39:58 | 00:07:02
2016-12-23 19:01:09 | 00:07:02
2016-12-24 06:36:22 | 00:07:02
2016-12-24 12:48:50 | 00:07:03
2016-12-25 22:15:08 | 00:07:01
2016-12-27 00:31:12 | 00:07:03
2016-12-27 09:32:13 | 00:07:03
2016-12-27 10:59:57 | 00:07:06
2016-12-27 23:47:42 | 00:07:02
2016-12-29 16:02:16 | 00:07:02
2016-12-29 17:59:57 | 00:07:02
2016-12-29 22:02:15 | 00:07:02
2016-12-31 23:52:04 | 00:07:01
2017-01-01 20:22:16 | 00:07:03
2017-01-02 17:32:16 | 00:07:02
2017-01-02 19:02:28 | 00:07:02
2017-01-03 03:21:03 | 00:07:04
2017-01-03 14:39:37 | 00:07:06
2017-01-03 19:52:21 | 00:07:03
2017-01-04 09:51:42 | 00:07:00
2017-01-04 11:19:37 | 00:07:00
2017-01-04 14:01:55 | 00:07:03
2017-01-04 17:01:55 | 00:07:01
2017-01-04 18:29:43 | 00:07:03
2017-01-04 22:34:46 | 00:07:05
2017-01-05 04:42:55 | 00:07:03
2017-01-05 10:52:02 | 00:07:06
2017-01-05 19:41:32 | 00:07:06
2017-01-06 14:52:06 | 00:07:04
2017-01-06 23:04:40 | 00:07:02
2017-01-07 21:12:09 | 00:07:04
2017-01-10 01:04:30 | 00:07:03
2017-01-10 08:03:46 | 00:07:04
2017-01-10 13:42:21 | 00:07:04
2017-01-10 15:09:54 | 00:07:04
2017-01-10 17:45:02 | 00:07:06
2017-01-11 04:54:49 | 00:07:00
2017-01-11 09:12:00 | 00:07:02
2017-01-11 21:56:33 | 00:07:02
2017-01-12 14:22:07 | 00:07:07
2017-01-12 16:52:43 | 00:07:03
2017-01-13 00:12:05 | 00:07:04
2017-01-13 19:45:30 | 00:07:02
2017-01-13 23:35:48 | 00:07:04
2017-01-14 02:32:24 | 00:07:05
2017-01-14 14:19:07 | 00:07:06
2017-01-14 16:19:06 | 00:07:08
2017-01-14 18:29:05 | 00:07:04
2017-01-15 00:20:01 | 00:07:07
2017-01-15 19:22:12 | 00:07:09
2017-01-16 10:02:25 | 00:07:10
2017-01-16 13:09:56 | 00:07:10
2017-01-16 17:32:24 | 00:07:07
2017-01-16 19:02:34 | 00:07:09
2017-01-16 20:32:33 | 00:07:11
2017-01-17 13:32:55 | 00:07:08
2017-01-17 17:49:05 | 00:07:05
2017-01-17 19:40:05 | 00:07:07
2017-01-17 21:39:59 | 00:07:06
2017-01-18 14:42:28 | 00:07:09
2017-01-18 17:59:07 | 00:07:09
2017-01-18 19:40:10 | 00:07:10
2017-01-19 22:52:22 | 00:07:10
2017-01-20 00:39:46 | 00:07:14
2017-01-20 01:59:45 | 00:07:13
2017-01-20 15:39:48 | 00:07:18
2017-01-20 17:09:47 | 00:07:14
2017-01-20 18:39:45 | 00:07:14
2017-01-20 20:02:30 | 00:07:14
2017-01-20 22:37:26 | 00:07:13
2017-01-21 03:18:24 | 00:07:12
2017-01-21 20:19:07 | 00:07:15
2017-01-21 21:50:03 | 00:07:14
2017-01-22 11:52:28 | 00:13:28
2017-01-22 16:52:32 | 00:07:13
2017-01-22 19:09:07 | 00:07:18
2017-01-23 13:39:40 | 00:07:13
2017-01-23 15:10:03 | 00:07:14
2017-01-23 16:40:03 | 00:07:13
2017-01-23 18:10:03 | 00:07:14
2017-01-23 19:40:05 | 00:07:13
2017-01-23 21:12:27 | 00:07:13
2017-01-24 05:27:21 | 00:07:12
2017-01-24 14:02:34 | 00:07:12
2017-01-24 15:50:15 | 00:07:10
2017-01-24 20:49:43 | 00:07:13
2017-01-24 23:02:12 | 00:07:17
2017-01-25 01:20:01 | 00:07:13
2017-01-25 03:12:24 | 00:07:16
2017-01-25 13:42:23 | 00:07:17
2017-01-25 15:10:17 | 00:07:13
2017-01-25 17:00:03 | 00:07:14
2017-01-25 18:20:09 | 00:07:14
2017-01-25 19:50:11 | 00:07:17
2017-01-26 15:52:33 | 00:07:17
2017-01-26 17:19:27 | 00:07:18
2017-01-26 23:21:11 | 00:07:15
2017-01-27 06:09:24 | 00:07:13
2017-01-27 16:10:57 | 00:07:11
2017-01-27 23:01:09 | 00:07:19
2017-01-30 05:30:10 | 00:07:16
2017-01-30 09:02:40 | 00:07:15
2017-01-30 21:18:13 | 00:07:15
2017-01-30 22:40:14 | 00:07:17
2017-01-31 00:10:11 | 00:07:20
2017-01-31 16:19:15 | 00:07:20
2017-01-31 18:55:34 | 00:07:14
2017-01-31 22:36:38 | 00:07:18
2017-02-01 09:32:46 | 00:07:19
2017-02-01 11:00:10 | 00:07:16
2017-02-01 12:20:13 | 00:07:15
2017-02-01 16:12:33 | 00:07:19
2017-02-01 17:40:10 | 00:07:16
2017-02-01 19:12:53 | 00:07:18
2017-02-01 21:22:52 | 00:07:16
2017-02-01 22:50:10 | 00:07:15
2017-02-02 01:32:32 | 00:07:17
2017-02-02 08:49:41 | 00:07:20
2017-02-02 12:19:15 | 00:07:17
2017-02-02 18:21:11 | 00:07:17
2017-02-03 16:22:37 | 00:07:16
2017-02-03 17:50:12 | 00:07:16
2017-02-03 19:10:13 | 00:07:18
2017-02-03 20:30:15 | 00:07:18
2017-02-03 21:52:59 | 00:07:17
2017-02-03 23:20:10 | 00:07:18
2017-02-04 00:40:11 | 00:07:16
2017-02-06 15:06:08 | 00:07:16
2017-02-06 21:13:21 | 00:07:16
2017-02-07 17:52:36 | 00:07:18
2017-02-07 20:22:41 | 00:07:19
2017-02-07 21:50:11 | 00:07:03
2017-02-07 23:30:02 | 00:07:00
2017-02-08 03:32:38 | 00:07:04
2017-02-08 21:02:56 | 00:07:04
2017-02-09 01:17:35 | 00:07:05
2017-02-09 17:02:48 | 00:07:04
2017-02-09 19:42:50 | 00:07:03
2017-02-10 00:07:45 | 00:06:59
2017-02-10 20:52:35 | 00:06:59
2017-02-13 01:46:24 | 00:07:00
2017-02-13 16:12:22 | 00:07:02
2017-02-14 16:32:19 | 00:07:02
2017-02-14 17:50:19 | 00:07:04
2017-02-14 20:52:23 | 00:07:02
2017-02-14 23:22:27 | 00:07:04
2017-02-15 02:09:09 | 00:07:04
2017-02-15 13:10:06 | 00:07:00
2017-02-15 15:12:23 | 00:07:06
2017-02-15 17:10:16 | 00:07:02
2017-02-15 18:43:24 | 00:07:07
2017-02-15 22:19:36 | 00:07:03
2017-02-16 04:36:52 | 00:07:02
2017-02-16 13:52:11 | 00:07:05
2017-02-16 18:12:18 | 00:07:08
2017-02-17 05:02:23 | 00:07:04
2017-02-17 14:02:24 | 00:07:05
2017-02-17 21:23:13 | 00:07:07
2017-02-18 03:16:55 | 00:07:05
2017-02-18 16:45:02 | 00:07:03
2017-02-19 08:42:12 | 00:07:04
2017-02-19 10:39:48 | 00:07:01
2017-02-19 16:12:13 | 00:07:05
2017-02-19 18:12:23 | 00:07:04
2017-02-19 23:48:53 | 00:07:03
2017-02-20 15:32:54 | 00:07:04
2017-02-21 16:49:21 | 00:07:03
2017-02-21 18:11:48 | 00:07:00
2017-02-21 19:40:04 | 00:07:03
2017-02-21 21:00:00 | 00:07:06
2017-02-21 22:22:30 | 00:07:05
2017-02-22 04:14:32 | 00:07:05
2017-02-22 06:52:27 | 00:07:06
2017-02-22 08:20:37 | 00:07:00
2017-02-22 16:22:30 | 00:07:05
2017-02-22 23:09:06 | 00:07:05
2017-02-23 13:40:04 | 00:07:05
2017-02-23 16:45:51 | 00:07:08
2017-02-23 19:00:25 | 00:07:06
2017-02-23 20:30:25 | 00:07:08
2017-02-23 22:20:30 | 00:07:06
2017-02-24 03:09:25 | 00:07:11
2017-02-24 07:02:36 | 00:07:06
2017-02-24 21:42:41 | 00:07:10
2017-02-24 23:10:26 | 00:07:07
2017-02-25 21:22:43 | 00:07:10
2017-02-25 23:22:37 | 00:07:07
2017-02-26 01:00:18 | 00:07:09
2017-02-26 08:23:00 | 00:07:06
2017-02-26 17:32:36 | 00:07:11
2017-02-26 19:00:19 | 00:07:08
2017-02-26 20:42:31 | 00:07:07
2017-02-27 12:12:39 | 00:07:03
2017-02-27 14:20:25 | 00:07:11
2017-02-27 16:32:31 | 00:07:06
2017-02-27 18:00:23 | 00:07:07
2017-02-27 22:32:44 | 00:07:02
2017-02-28 14:41:21 | 00:07:04
2017-02-28 18:42:35 | 00:07:04
2017-03-01 05:10:21 | 00:07:04
2017-03-01 09:19:23 | 00:07:06
2017-03-01 14:02:31 | 00:07:03
2017-03-01 17:02:45 | 00:07:06
2017-03-01 19:20:26 | 00:07:05
2017-03-02 06:15:05 | 00:07:05
2017-03-02 11:52:32 | 00:12:56
2017-03-02 13:20:25 | 00:07:06
2017-03-02 14:43:43 | 00:07:07
2017-03-03 03:52:33 | 00:07:03
2017-03-03 05:30:26 | 00:07:05
2017-03-03 06:50:28 | 00:07:05
2017-03-03 14:02:42 | 00:07:05
2017-03-03 15:30:23 | 00:07:04
2017-03-03 17:00:25 | 00:07:03
2017-03-03 19:19:55 | 00:07:07
2017-03-03 23:32:45 | 00:07:06
2017-03-04 01:59:25 | 00:07:04
2017-03-04 04:52:41 | 00:07:06
2017-03-04 19:49:28 | 00:07:04
2017-03-04 23:30:13 | 00:07:04
2017-03-06 10:32:46 | 00:07:06
2017-03-06 12:00:27 | 00:07:09
2017-03-06 14:42:49 | 00:07:08
2017-03-06 17:32:44 | 00:07:05
2017-03-06 19:00:28 | 00:07:04
2017-03-07 00:12:15 | 00:07:04
2017-03-07 06:20:46 | 00:07:06
2017-03-07 12:37:02 | 00:07:04
2017-03-07 14:40:32 | 00:07:03
2017-03-07 16:00:33 | 00:07:07
2017-03-07 18:33:21 | 00:07:10
2017-03-07 20:00:24 | 00:07:10
2017-03-07 21:20:25 | 00:07:08
2017-03-07 22:40:28 | 00:07:05
2017-03-08 03:55:42 | 00:07:05
2017-03-08 13:24:32 | 00:07:09
2017-03-08 19:11:38 | 00:07:10
2017-03-08 23:13:54 | 00:07:08
2017-03-09 01:52:47 | 00:07:09
2017-03-09 03:20:29 | 00:07:12
2017-03-09 13:02:55 | 00:07:11
2017-03-09 15:00:30 | 00:07:13
2017-03-09 16:20:29 | 00:07:05
2017-03-09 17:50:30 | 00:07:09
2017-03-09 21:42:53 | 00:07:10
2017-03-10 03:38:14 | 00:07:11
2017-03-10 05:50:32 | 00:07:10
2017-03-10 14:34:08 | 00:07:12
2017-03-10 16:00:34 | 00:07:09
2017-03-10 17:23:24 | 00:07:10
2017-03-10 18:50:35 | 00:07:09
2017-03-11 00:44:22 | 00:07:03
2017-03-11 19:43:09 | 00:07:09
2017-03-11 23:46:59 | 00:07:08
2017-03-12 20:12:53 | 00:07:09
2017-03-13 04:14:43 | 00:07:13
2017-03-13 11:22:36 | 00:07:15
2017-03-13 13:32:35 | 00:07:12
2017-03-13 17:09:14 | 00:07:12
2017-03-13 18:53:04 | 00:07:11
2017-03-14 00:57:24 | 00:07:10
2017-03-14 12:04:27 | 00:07:07
2017-03-14 20:49:37 | 00:07:16
2017-03-15 00:50:04 | 00:07:16
2017-03-15 04:09:49 | 00:07:17
2017-03-15 11:38:51 | 00:07:15
2017-03-15 15:02:35 | 00:07:17
2017-03-15 16:30:23 | 00:07:17
2017-03-15 19:23:52 | 00:07:14
2017-03-15 20:50:16 | 00:07:18
2017-03-15 22:10:18 | 00:07:18
2017-03-16 02:12:59 | 00:07:17
2017-03-16 03:40:23 | 00:07:16
2017-03-16 05:10:20 | 00:07:18
2017-03-16 18:06:40 | 00:07:16
2017-03-16 19:30:27 | 00:07:17
2017-03-17 03:17:00 | 00:07:20
2017-03-17 09:19:35 | 00:07:18
2017-03-17 15:23:09 | 00:07:16
2017-03-17 18:59:34 | 00:07:17
2017-03-18 09:43:09 | 00:07:19
2017-03-18 11:53:39 | 00:07:14
2017-03-18 17:19:36 | 00:07:16
2017-03-18 18:50:45 | 00:07:18
2017-03-18 21:56:38 | 00:07:17
2017-03-18 23:30:35 | 00:07:16
2017-03-19 16:13:24 | 00:07:15
2017-03-19 21:03:15 | 00:07:21
2017-03-20 17:05:22 | 00:07:15
2017-03-20 18:30:40 | 00:07:18
2017-03-20 20:14:18 | 00:07:18
2017-03-20 21:40:42 | 00:07:16
2017-03-20 23:40:37 | 00:07:22
2017-03-21 01:59:36 | 00:07:19
2017-03-21 13:13:04 | 00:07:20
2017-03-21 16:23:40 | 00:07:21
2017-03-22 03:50:04 | 00:07:25
2017-03-22 05:20:32 | 00:07:21
2017-03-22 07:13:20 | 00:07:21
2017-03-22 13:23:04 | 00:07:24
2017-03-22 15:00:38 | 00:07:23
2017-03-22 16:30:38 | 00:07:20
2017-03-22 18:00:42 | 00:07:21
2017-03-22 19:40:34 | 00:07:20
2017-03-23 03:53:14 | 00:07:19
2017-03-23 09:23:13 | 00:07:22
2017-03-23 13:10:15 | 00:07:24
2017-03-23 15:20:39 | 00:07:20
2017-03-23 16:50:45 | 00:07:25
2017-03-23 18:20:41 | 00:07:20
2017-03-23 21:10:30 | 00:07:23
2017-03-24 03:33:12 | 00:07:23
2017-03-24 19:44:02 | 00:07:27
2017-03-24 21:10:40 | 00:07:26
2017-03-25 02:03:13 | 00:07:27
2017-03-25 03:43:18 | 00:07:25
2017-03-25 05:10:47 | 00:07:27
2017-03-25 14:09:38 | 00:07:27
2017-03-25 15:50:42 | 00:07:27
2017-03-25 21:43:18 | 00:07:29
2017-03-25 23:10:57 | 00:07:27
2017-03-26 03:53:16 | 00:07:29
2017-03-26 05:20:42 | 00:07:27
2017-03-26 14:43:13 | 00:07:28
2017-03-26 16:10:48 | 00:07:29
2017-03-26 20:03:36 | 00:07:28
2017-03-27 00:42:25 | 00:07:29
2017-03-27 03:37:47 | 00:07:25
2017-03-27 15:53:57 | 00:07:29
2017-03-27 17:20:53 | 00:07:28
2017-03-27 19:20:48 | 00:07:29
2017-03-28 00:23:21 | 00:07:31
2017-03-28 13:13:25 | 00:07:28
2017-03-28 14:40:48 | 00:07:29
2017-03-28 16:10:54 | 00:07:31
2017-03-28 19:45:05 | 00:07:33
2017-03-28 22:13:36 | 00:07:30
2017-03-29 00:20:51 | 00:07:31
2017-03-29 01:50:46 | 00:07:30
2017-03-29 03:20:59 | 00:07:31
2017-03-29 13:03:34 | 00:07:28
2017-03-29 15:03:23 | 00:07:28
2017-03-29 16:30:47 | 00:07:27
2017-03-29 18:00:49 | 00:07:33
2017-03-29 19:30:50 | 00:07:31
2017-03-29 21:00:51 | 00:07:28
2017-03-30 13:43:24 | 00:07:27
2017-03-30 17:10:28 | 00:07:35
2017-03-30 19:20:47 | 00:07:30
2017-03-31 07:13:30 | 00:07:26
2017-03-31 18:33:40 | 00:07:33
2017-03-31 20:20:50 | 00:07:30
2017-03-31 22:00:55 | 00:07:31
2017-03-31 23:40:52 | 00:07:29
2017-04-01 03:24:30 | 00:07:29
2017-04-01 05:01:04 | 00:07:35
2017-04-01 07:10:48 | 00:07:36
2017-04-01 15:23:28 | 00:07:31
2017-04-01 19:46:16 | 00:07:36
2017-04-01 21:40:53 | 00:07:36
2017-04-02 01:53:39 | 00:07:35
2017-04-02 18:03:47 | 00:07:33
2017-04-02 21:03:32 | 00:07:36
2017-04-02 23:33:47 | 00:07:37
2017-04-03 15:19:48 | 00:07:32
2017-04-03 20:33:29 | 00:07:34
2017-04-03 22:43:37 | 00:07:36
2017-04-04 02:29:48 | 00:07:32
2017-04-04 04:01:06 | 00:07:33
2017-04-04 11:54:00 | 00:07:31
2017-04-04 13:21:00 | 00:07:37
2017-04-04 17:03:37 | 00:07:32
2017-04-04 19:59:46 | 00:07:30
2017-04-04 21:53:32 | 00:07:31
2017-04-04 23:20:54 | 00:07:37
2017-04-05 01:21:02 | 00:07:30
2017-04-05 04:10:20 | 00:07:35
2017-04-05 05:41:03 | 00:07:33
2017-04-05 13:13:33 | 00:07:33
2017-04-05 15:23:53 | 00:07:33
2017-04-05 16:50:57 | 00:07:37
2017-04-05 18:21:04 | 00:07:33
2017-04-05 19:50:59 | 00:07:35
2017-04-05 22:14:07 | 00:07:42
2017-04-06 00:11:04 | 00:07:42
2017-04-06 07:01:42 | 00:07:44
2017-04-06 14:43:33 | 00:07:45
2017-04-06 16:30:58 | 00:07:50
2017-04-06 18:10:53 | 00:07:45
2017-04-06 19:40:59 | 00:07:43
2017-04-07 02:28:09 | 00:07:59
2017-04-07 04:20:57 | 00:07:57
2017-04-07 07:43:42 | 00:07:57
2017-04-07 11:59:50 | 00:08:01
2017-04-07 16:19:49 | 00:08:05
2017-04-07 18:57:00 | 00:07:59
2017-04-07 20:30:57 | 00:08:01
2017-04-07 22:01:08 | 00:08:03
2017-04-08 00:01:02 | 00:08:01
2017-04-08 01:30:55 | 00:08:02
2017-04-08 03:31:10 | 00:08:00
2017-04-08 10:43:38 | 00:11:35
2017-04-08 18:33:54 | 00:08:03
2017-04-08 20:39:51 | 00:07:57
2017-04-09 21:13:47 | 00:08:01
2017-04-09 23:10:25 | 00:08:02
2017-04-10 14:34:05 | 00:08:00
2017-04-10 16:30:54 | 00:08:01
2017-04-11 00:59:13 | 00:08:02
2017-04-11 13:10:02 | 00:08:01
2017-04-11 14:40:43 | 00:08:00
2017-04-11 16:21:02 | 00:08:03
2017-04-11 17:50:37 | 00:08:02
2017-04-11 19:20:35 | 00:08:01
2017-04-11 20:50:33 | 00:08:01
2017-04-12 12:03:28 | 00:07:58
2017-04-12 15:43:36 | 00:08:02
2017-04-12 17:10:37 | 00:07:59
2017-04-12 18:53:47 | 00:07:59
2017-04-12 20:24:42 | 00:06:52
2017-04-13 02:33:49 | 00:06:54
2017-04-13 09:23:30 | 00:06:55
2017-04-13 13:23:29 | 00:06:55
2017-04-13 14:55:04 | 00:06:52
2017-04-13 16:20:54 | 00:06:53
2017-04-13 17:50:43 | 00:06:52
2017-04-13 21:19:34 | 00:06:50
2017-04-14 02:34:11 | 00:06:51
2017-04-14 04:00:55 | 00:06:52
2017-04-14 17:03:46 | 00:06:53
2017-04-14 18:34:44 | 00:06:55
2017-04-14 23:42:13 | 00:06:47
2017-04-15 04:03:52 | 00:06:52
2017-04-15 14:03:42 | 00:06:52
2017-04-15 18:23:44 | 00:06:54
2017-04-15 21:35:44 | 00:06:52
2017-04-16 03:41:00 | 00:06:52
2017-04-16 18:13:48 | 00:06:57
2017-04-16 23:49:51 | 00:06:57
2017-04-17 03:40:32 | 00:06:56
2017-04-17 14:03:54 | 00:06:51
2017-04-17 18:33:28 | 00:06:51
2017-04-17 23:48:20 | 00:06:55
2017-04-18 03:53:49 | 00:06:53
2017-04-18 09:53:56 | 00:06:58
2017-04-18 11:20:54 | 00:06:57
2017-04-18 12:50:56 | 00:06:55
2017-04-18 14:53:51 | 00:06:52
2017-04-18 16:20:54 | 00:06:56
2017-04-18 17:40:55 | 00:06:56
2017-04-18 19:20:51 | 00:06:56
2017-04-18 20:40:51 | 00:06:51
2017-04-19 20:59:49 | 00:06:55
2017-04-20 14:23:51 | 00:06:52
2017-04-20 15:50:49 | 00:06:55
2017-04-20 17:20:51 | 00:06:58
2017-04-20 18:40:54 | 00:06:53
2017-04-20 22:30:54 | 00:06:54
2017-04-21 12:49:46 | 00:06:52
2017-04-21 18:49:45 | 00:06:55
2017-04-22 00:44:39 | 00:06:55
2017-04-22 06:14:20 | 00:06:52
2017-04-22 14:29:50 | 00:06:57
2017-04-22 20:59:47 | 00:06:52
2017-04-22 23:36:40 | 00:06:51
2017-04-23 13:34:20 | 00:06:52
2017-04-23 21:45:55 | 00:06:52
2017-04-24 01:14:36 | 00:06:52
2017-04-24 15:24:04 | 00:06:51
2017-04-24 20:32:50 | 00:06:51
2017-04-25 00:04:35 | 00:06:49
2017-04-25 03:00:19 | 00:06:54
2017-04-25 14:54:06 | 00:06:56
2017-04-25 16:21:13 | 00:06:53
2017-04-25 18:50:40 | 00:06:53
2017-04-25 20:59:56 | 00:06:57
2017-04-26 15:04:03 | 00:06:52
2017-04-26 16:31:07 | 00:06:52
2017-04-26 18:24:04 | 00:06:56
2017-04-26 19:51:07 | 00:06:52
2017-04-26 22:23:33 | 00:06:55
2017-04-27 01:24:10 | 00:06:54
2017-04-27 12:29:58 | 00:06:54
2017-04-27 14:01:06 | 00:06:53
2017-04-27 20:16:37 | 00:06:53
2017-04-28 00:51:06 | 00:06:54
2017-04-28 12:34:18 | 00:06:54
2017-04-28 17:49:56 | 00:06:58
2017-04-28 23:54:39 | 00:06:59
2017-04-30 01:40:34 | 00:06:52
2017-04-30 16:33:57 | 00:06:51
2017-04-30 22:18:22 | 00:06:53
2017-05-01 12:44:14 | 00:06:48
2017-05-01 14:34:43 | 00:06:44
2017-05-01 19:52:35 | 00:06:51
2017-05-03 00:42:22 | 00:06:53
2017-05-03 07:05:02 | 00:06:44
2017-05-03 08:35:01 | 00:06:52
2017-05-03 19:04:24 | 00:06:48
2017-05-04 00:46:58 | 00:06:33
2017-05-04 04:46:38 | 00:06:32
2017-05-04 09:40:37 | 00:06:35
2017-05-04 20:12:24 | 00:06:34
2017-05-05 02:19:57 | 00:06:35
2017-05-05 08:10:16 | 00:06:37
2017-05-05 14:28:43 | 00:06:37
2017-05-05 16:58:30 | 00:06:34
2017-05-07 00:16:41 | 00:06:31
2017-05-07 04:07:42 | 00:06:32
2017-05-07 18:43:01 | 00:06:35
2017-05-08 08:04:44 | 00:06:35
2017-05-08 09:31:16 | 00:06:33
2017-05-08 18:18:13 | 00:06:34
2017-05-09 00:27:29 | 00:06:34
2017-05-09 13:34:52 | 00:06:38
2017-05-09 15:02:08 | 00:06:39
2017-05-09 21:57:50 | 00:06:38
2017-05-10 02:54:30 | 00:06:35
2017-05-10 04:21:19 | 00:06:36
2017-05-10 18:24:52 | 00:06:36
2017-05-10 21:54:34 | 00:06:37
2017-05-11 16:04:37 | 00:06:37
2017-05-11 21:58:14 | 00:06:35
2017-05-12 10:14:27 | 00:06:35
2017-05-12 11:49:55 | 00:06:34
2017-05-12 13:14:59 | 00:06:40
2017-05-12 19:04:01 | 00:06:37
2017-05-12 21:11:20 | 00:06:38
2017-05-13 02:00:34 | 00:06:37
2017-05-13 04:39:26 | 00:06:34
2017-05-13 07:04:16 | 00:06:38
2017-05-13 13:54:10 | 00:06:30
2017-05-13 15:44:28 | 00:06:33
2017-05-13 17:51:13 | 00:06:37
2017-05-13 19:41:14 | 00:06:32
2017-05-14 00:38:34 | 00:06:36
2017-05-14 07:46:23 | 00:06:33
2017-05-14 15:04:42 | 00:06:36
2017-05-14 17:01:17 | 00:06:35
2017-05-14 18:51:12 | 00:06:34
2017-05-15 01:14:10 | 00:06:32
2017-05-15 03:42:48 | 00:06:35
2017-05-15 09:10:02 | 00:06:33
2017-05-15 14:44:20 | 00:06:33
2017-05-15 18:14:12 | 00:06:34
2017-05-15 20:00:56 | 00:06:37
2017-05-15 21:40:46 | 00:06:35
2017-05-16 03:30:06 | 00:06:32
2017-05-16 17:45:05 | 00:06:36
2017-05-16 19:34:00 | 00:06:34
2017-05-16 22:23:37 | 00:06:36
2017-05-16 23:54:01 | 00:06:38
2017-05-17 01:24:09 | 00:06:34
2017-05-17 02:53:48 | 00:06:34
2017-05-17 04:23:51 | 00:06:33
2017-05-17 19:32:40 | 00:06:32
2017-05-17 22:28:51 | 00:06:35
2017-05-18 00:32:38 | 00:06:35
2017-05-18 02:01:59 | 00:06:35
2017-05-18 10:34:39 | 00:06:37
2017-05-18 18:14:12 | 00:06:37
2017-05-18 19:41:20 | 00:06:36
2017-05-19 09:40:47 | 00:06:36
2017-05-19 19:04:13 | 00:06:37
2017-05-19 20:31:25 | 00:06:33
2017-05-19 21:51:16 | 00:06:35
2017-05-19 23:11:15 | 00:06:32
2017-05-21 06:24:53 | 00:06:36
2017-05-21 16:03:54 | 00:06:36
2017-05-21 21:51:22 | 00:06:35
2017-05-22 07:30:54 | 00:06:34
2017-05-23 08:34:19 | 00:06:36
2017-05-23 10:04:48 | 00:06:38
2017-05-23 22:44:45 | 00:06:36
2017-05-24 20:37:53 | 00:06:32
2017-05-25 01:19:31 | 00:06:37
2017-05-25 13:04:03 | 00:06:40
2017-05-25 15:34:11 | 00:06:38
2017-05-25 18:53:59 | 00:06:35
2017-05-26 21:40:52 | 00:06:38
2017-05-28 19:10:54 | 00:06:40
2017-05-29 03:34:16 | 00:06:37
2017-05-29 14:30:16 | 00:06:36
2017-05-29 18:40:51 | 00:06:38
2017-05-30 00:36:41 | 00:06:37
2017-05-30 06:25:09 | 00:06:34
2017-05-30 15:58:02 | 00:06:34
2017-05-30 21:07:38 | 00:06:33
2017-05-30 22:34:52 | 00:06:41
2017-05-31 00:01:21 | 00:06:37
2017-05-31 15:34:37 | 00:06:33
2017-05-31 18:40:50 | 00:06:33
2017-06-01 11:01:39 | 00:06:40
2017-06-01 22:17:01 | 00:06:37
2017-06-02 01:40:58 | 00:06:38
2017-06-02 03:24:26 | 00:06:35
2017-06-02 07:54:07 | 00:06:38
2017-06-02 09:24:59 | 00:06:38
2017-06-02 19:11:00 | 00:06:37
2017-06-02 20:31:30 | 00:06:35
2017-06-03 03:36:00 | 00:06:32
2017-06-03 13:34:18 | 00:06:35
2017-06-03 16:01:00 | 00:06:35
2017-06-03 18:04:17 | 00:06:39
2017-06-03 19:31:26 | 00:06:37
2017-06-03 21:30:54 | 00:06:38
2017-06-04 00:54:07 | 00:06:40
2017-06-04 16:57:18 | 00:06:40
2017-06-04 19:31:27 | 00:06:40
2017-06-04 20:51:26 | 00:06:39
2017-06-05 08:54:11 | 00:06:36
2017-06-05 21:43:38 | 00:06:38
2017-06-06 02:28:13 | 00:06:37
2017-06-06 15:24:52 | 00:06:39
2017-06-06 16:34:59 | 00:06:38
2017-06-06 18:54:55 | 00:06:38
2017-06-07 00:04:51 | 00:06:39
2017-06-07 02:14:53 | 00:06:37
2017-06-07 06:44:51 | 00:06:41
2017-06-07 15:09:03 | 00:06:40
2017-06-07 17:14:53 | 00:06:40
2017-06-07 18:25:00 | 00:06:41
2017-06-07 23:28:42 | 00:06:42
2017-06-08 01:14:53 | 00:06:45
2017-06-08 15:35:01 | 00:06:45
2017-06-08 16:45:02 | 00:06:43
2017-06-08 17:55:02 | 00:06:41
2017-06-08 19:54:57 | 00:06:39
2017-06-08 22:04:52 | 00:06:38
2017-06-08 23:15:02 | 00:06:38
2017-06-09 09:14:57 | 00:06:39
2017-06-09 10:25:02 | 00:06:40
2017-06-09 13:34:53 | 00:06:38
2017-06-09 14:45:03 | 00:06:40
2017-06-09 15:55:02 | 00:06:43
2017-06-09 18:14:54 | 00:06:38
2017-06-09 19:25:04 | 00:06:40
2017-06-10 17:25:08 | 00:06:38
2017-06-11 15:54:56 | 00:06:40
2017-06-11 23:04:54 | 00:06:42
2017-06-12 13:04:53 | 00:06:43
2017-06-12 14:34:54 | 00:06:42
2017-06-12 15:45:05 | 00:06:45
2017-06-12 20:04:57 | 00:06:41
2017-06-12 21:15:04 | 00:06:41
2017-06-13 02:14:24 | 00:06:39
2017-06-13 03:25:05 | 00:06:40
2017-06-13 04:35:04 | 00:06:38
2017-06-13 13:04:56 | 00:06:38
2017-06-13 14:25:03 | 00:06:42
2017-06-13 15:35:07 | 00:06:45
2017-06-13 16:45:05 | 00:06:38
2017-06-13 17:55:08 | 00:06:43
2017-06-13 19:15:06 | 00:06:38
2017-06-14 03:54:56 | 00:06:38
2017-06-14 07:54:56 | 00:06:41
2017-06-14 14:34:55 | 00:06:38
2017-06-14 15:45:05 | 00:06:43
2017-06-14 17:14:59 | 00:06:39
2017-06-14 18:54:55 | 00:06:42
2017-06-14 20:05:04 | 00:06:41
2017-06-14 21:25:05 | 00:06:37
2017-06-15 13:25:03 | 00:06:37
2017-06-15 14:35:05 | 00:06:39
2017-06-15 15:45:05 | 00:06:40
2017-06-15 16:55:10 | 00:06:39
2017-06-15 23:29:22 | 00:06:39
2017-06-16 07:25:00 | 00:06:37
2017-06-16 08:44:59 | 00:06:37
2017-06-16 14:17:27 | 00:06:39
2017-06-16 16:25:00 | 00:06:35
2017-06-17 03:24:57 | 00:06:39
2017-06-17 04:35:08 | 00:06:36
2017-06-17 08:25:00 | 00:06:34
2017-06-17 13:04:57 | 00:06:35
2017-06-19 05:25:27 | 00:06:37
2017-06-19 19:18:37 | 00:06:38
2017-06-19 21:34:31 | 00:06:39
2017-06-20 02:17:39 | 00:06:37
2017-06-20 14:15:02 | 00:06:38
2017-06-20 16:45:00 | 00:06:39
2017-06-20 22:42:11 | 00:06:37
2017-06-21 11:02:19 | 00:08:24
2017-06-21 18:14:58 | 00:06:45
2017-06-21 19:35:38 | 00:06:40
2017-06-22 01:49:48 | 00:06:39
2017-06-22 03:45:05 | 00:06:38
2017-06-22 13:44:56 | 00:06:40
2017-06-22 15:04:52 | 00:06:38
2017-06-22 16:15:06 | 00:06:42
2017-06-22 17:25:06 | 00:06:42
2017-06-22 18:35:06 | 00:06:38
2017-06-23 00:18:10 | 00:06:42
2017-06-23 15:05:02 | 00:06:39
2017-06-23 16:24:58 | 00:06:39
2017-06-23 18:14:56 | 00:06:39
2017-06-23 19:25:09 | 00:06:37
2017-06-23 20:45:07 | 00:06:38
2017-06-24 12:14:56 | 00:06:38
2017-06-24 13:25:07 | 00:06:37
2017-06-24 18:04:58 | 00:06:39
2017-06-26 15:34:35 | 00:06:37
2017-06-26 18:44:59 | 00:06:38
2017-06-26 19:55:08 | 00:06:38
2017-06-27 01:19:29 | 00:06:38
2017-06-28 01:28:24 | 00:06:36
2017-06-28 15:45:02 | 00:06:38
2017-06-28 21:09:54 | 00:06:41
2017-06-28 22:45:06 | 00:06:41
2017-06-29 02:15:01 | 00:06:42
2017-06-30 13:05:03 | 00:06:38
2017-06-30 14:15:07 | 00:06:39
2017-06-30 15:34:56 | 00:06:42
2017-06-30 19:34:21 | 00:06:42
2017-06-30 20:45:07 | 00:06:42
2017-06-30 21:55:07 | 00:06:41
2017-06-30 23:05:06 | 00:06:46
2017-07-01 04:35:39 | 00:06:40
2017-07-01 16:24:59 | 00:06:40
2017-07-01 18:35:01 | 00:06:40
2017-07-02 03:14:57 | 00:06:46
2017-07-02 18:05:04 | 00:06:40
2017-07-02 19:34:55 | 00:06:46
2017-07-02 21:24:58 | 00:06:45
2017-07-03 02:05:04 | 00:06:43
2017-07-03 09:15:00 | 00:06:45
2017-07-03 16:21:31 | 00:06:39
2017-07-04 02:54:56 | 00:06:38
2017-07-05 01:15:07 | 00:06:41
2017-07-05 15:05:03 | 00:06:39
2017-07-05 17:44:54 | 00:06:43
2017-07-05 19:24:58 | 00:06:42
2017-07-06 04:04:54 | 00:06:39
2017-07-06 09:04:55 | 00:06:43
2017-07-06 11:54:57 | 00:06:43
2017-07-06 17:58:09 | 00:06:44
2017-07-07 12:14:59 | 00:06:41
2017-07-07 22:14:44 | 00:06:42
2017-07-08 16:45:05 | 00:06:38
2017-07-09 07:54:58 | 00:06:36
2017-07-10 09:34:58 | 00:06:39
2017-07-10 10:54:54 | 00:09:46
2017-07-10 12:34:59 | 00:06:38
2017-07-10 19:17:19 | 00:06:45
2017-07-10 20:34:56 | 00:06:40
2017-07-12 00:59:46 | 00:06:40
2017-07-12 13:50:08 | 00:06:41
2017-07-12 19:09:11 | 00:06:39
2017-07-13 00:20:21 | 00:06:40
2017-07-13 16:59:56 | 00:06:48
2017-07-14 03:40:51 | 00:06:42
2017-07-14 17:19:34 | 00:06:40
2017-07-14 19:35:05 | 00:06:38
2017-07-14 23:35:04 | 00:06:38
2017-07-15 18:05:02 | 00:06:43
2017-07-15 21:05:03 | 00:06:39
2017-07-16 18:17:44 | 00:06:43
2017-07-17 06:25:01 | 00:06:39
2017-07-17 16:15:02 | 00:06:40
2017-07-17 23:39:37 | 00:06:43
2017-07-18 01:55:02 | 00:06:46
2017-07-18 03:15:12 | 00:06:42
2017-07-18 16:55:06 | 00:06:48
2017-07-18 18:05:12 | 00:06:36
2017-07-19 20:24:57 | 00:06:46
2017-07-20 19:01:30 | 00:06:45
2017-07-21 09:25:04 | 00:06:46
2017-07-21 11:35:41 | 00:06:39
2017-07-21 20:21:11 | 00:06:46
2017-07-22 01:12:35 | 00:06:39
2017-07-22 16:25:01 | 00:06:42
2017-07-22 22:05:04 | 00:06:37
2017-07-23 03:52:00 | 00:06:42
2017-07-24 11:10:18 | 00:06:49
2017-07-24 15:25:05 | 00:06:42
2017-07-24 23:31:26 | 00:06:46
2017-07-25 17:45:03 | 00:06:45
2017-07-26 00:12:36 | 00:06:39
2017-07-26 15:44:57 | 00:06:42
2017-07-27 01:00:39 | 00:06:47
2017-07-27 05:21:51 | 00:06:46
2017-07-27 15:14:59 | 00:06:43
2017-07-27 17:35:02 | 00:06:40
2017-07-27 22:51:11 | 00:06:43
2017-07-28 16:34:58 | 00:06:42
2017-07-28 18:34:57 | 00:06:47
2017-07-28 21:54:56 | 00:06:44
2017-08-01 01:31:32 | 00:06:47
2017-08-01 08:45:11 | 00:06:46
2017-08-01 15:45:04 | 00:06:49
2017-08-01 17:55:03 | 00:06:48
2017-08-01 20:15:03 | 00:06:46
2017-08-01 22:05:17 | 00:06:46
2017-08-02 00:25:03 | 00:06:46
2017-08-02 14:55:05 | 00:06:53
2017-08-02 17:43:19 | 00:06:48
2017-08-02 23:41:27 | 00:06:51
2017-08-03 03:21:14 | 00:06:51
2017-08-03 16:05:09 | 00:06:49
2017-08-03 19:03:14 | 00:06:49
2017-08-03 23:40:44 | 00:06:53
2017-08-04 05:09:22 | 00:06:54
2017-08-04 19:22:25 | 00:06:48
2017-08-04 21:25:06 | 00:06:51
2017-08-04 23:15:16 | 00:06:47
2017-08-05 01:05:15 | 00:06:51
2017-08-05 02:55:16 | 00:06:53
2017-08-05 13:45:08 | 00:06:47
2017-08-05 18:41:39 | 00:06:49
2017-08-06 00:59:44 | 00:06:50
2017-08-07 00:29:46 | 00:06:52
2017-08-07 03:35:03 | 00:06:47
2017-08-07 13:25:12 | 00:06:52
2017-08-07 19:23:09 | 00:06:50
2017-08-07 23:39:12 | 00:06:47
2017-08-08 19:45:17 | 00:06:51
2017-08-08 21:45:18 | 00:06:52
2017-08-09 03:13:14 | 00:06:52
2017-08-09 18:09:46 | 00:06:52
2017-08-10 01:12:59 | 00:06:48
2017-08-10 15:35:04 | 00:06:48
2017-08-10 17:25:13 | 00:06:52
2017-08-10 19:15:13 | 00:06:51
2017-08-11 02:25:05 | 00:06:54
2017-08-11 04:25:15 | 00:06:53
2017-08-11 19:25:10 | 00:06:49
2017-08-11 21:15:16 | 00:06:46
2017-08-11 23:05:12 | 00:06:49
2017-08-12 16:15:05 | 00:06:49
2017-08-13 03:35:04 | 00:06:47
2017-08-14 00:42:08 | 00:06:40
2017-08-14 09:35:04 | 00:06:48
2017-08-14 20:07:50 | 00:06:48
2017-08-15 01:58:40 | 00:06:46
2017-08-15 05:42:19 | 00:06:43
2017-08-15 14:10:02 | 00:06:48
2017-08-15 17:21:27 | 00:06:47
2017-08-15 20:40:04 | 00:06:47
2017-08-15 23:40:06 | 00:06:47
2017-08-16 06:44:17 | 00:06:43
2017-08-16 09:35:12 | 00:06:41
2017-08-16 16:55:43 | 00:06:49
2017-08-16 19:05:11 | 00:06:39
2017-08-16 21:45:25 | 00:06:45
2017-08-16 23:35:25 | 00:06:41
2017-08-17 02:30:19 | 00:06:47
2017-08-17 17:28:12 | 00:06:47
2017-08-18 00:36:59 | 00:06:48
2017-08-18 18:38:46 | 00:06:44
2017-08-19 04:20:10 | 00:06:48
2017-08-19 22:15:56 | 00:06:46
2017-08-20 18:25:30 | 00:06:47
2017-08-21 05:39:59 | 00:06:48
2017-08-21 18:45:27 | 00:06:40
2017-08-22 00:50:05 | 00:06:47
2017-08-22 23:35:11 | 00:06:45
2017-08-23 03:10:34 | 00:06:46
2017-08-23 05:55:19 | 00:06:42
2017-08-23 17:25:28 | 00:06:40
2017-08-23 23:06:50 | 00:06:49
2017-08-24 15:25:24 | 00:06:40
2017-08-24 17:45:14 | 00:06:46
2017-08-24 22:51:08 | 00:06:49
2017-08-25 02:40:11 | 00:06:48
2017-08-25 13:15:17 | 00:06:38
2017-08-25 19:55:29 | 00:06:46
2017-08-26 11:05:21 | 00:06:44
2017-08-26 13:35:14 | 00:06:41
2017-08-26 17:15:13 | 00:06:41
2017-08-28 15:30:35 | 00:06:49
2017-08-29 17:25:17 | 00:06:40
2017-08-30 00:45:16 | 00:06:40
2017-08-30 18:53:52 | 00:06:49
2017-08-30 22:49:35 | 00:06:49
2017-08-31 02:45:13 | 00:06:42
2017-08-31 18:31:06 | 00:06:50
2017-08-31 21:50:50 | 00:06:51
2017-09-01 04:25:15 | 00:06:53
2017-09-01 13:11:50 | 00:06:47
2017-09-01 16:10:57 | 00:06:50
2017-09-02 03:44:00 | 00:06:51
2017-09-03 20:14:08 | 00:06:50
2017-09-04 11:18:58 | 00:06:54
2017-09-04 17:55:22 | 00:06:52
2017-09-04 20:25:14 | 00:06:54
2017-09-04 22:15:32 | 00:06:48
2017-09-05 14:25:27 | 00:06:51
2017-09-05 17:20:45 | 00:06:51
2017-09-05 19:15:37 | 00:06:55
2017-09-05 23:01:06 | 00:06:43
2017-09-06 16:25:19 | 00:06:51
2017-09-06 19:50:56 | 00:06:51
2017-09-06 22:15:26 | 00:06:49
2017-09-07 12:05:19 | 00:06:50
2017-09-07 13:55:25 | 00:06:51
2017-09-07 17:34:56 | 00:06:51
2017-09-07 19:35:31 | 00:06:50
2017-09-07 23:45:22 | 00:06:50
2017-09-08 02:05:27 | 00:06:51
2017-09-08 13:35:17 | 00:06:53
2017-09-08 15:35:15 | 00:06:51
2017-09-08 17:25:26 | 00:06:51
2017-09-08 20:20:44 | 00:06:48
2017-09-09 00:21:14 | 00:06:53
2017-09-09 02:15:27 | 00:06:55
2017-09-09 23:01:23 | 00:06:51
2017-09-10 17:35:17 | 00:06:56
2017-09-10 20:31:06 | 00:06:51
2017-09-11 15:35:09 | 00:06:54
2017-09-11 20:25:09 | 00:06:53
2017-09-11 22:15:29 | 00:06:53
2017-09-12 04:09:50 | 00:06:51
2017-09-12 13:55:19 | 00:06:53
2017-09-12 19:25:13 | 00:06:52
2017-09-12 23:35:18 | 00:06:56
2017-09-13 12:25:21 | 00:06:55
2017-09-13 15:20:57 | 00:06:51
2017-09-13 17:35:25 | 00:06:53
2017-09-14 01:57:52 | 00:06:52
2017-09-14 10:21:45 | 00:08:19
2017-09-14 16:21:48 | 00:06:53
2017-09-14 19:05:25 | 00:06:53
2017-09-14 21:05:27 | 00:06:57
2017-09-15 01:11:46 | 00:06:52
2017-09-15 04:35:13 | 00:06:51
2017-09-15 07:05:26 | 00:06:52
2017-09-15 12:25:24 | 00:06:54
2017-09-15 14:55:18 | 00:06:55
2017-09-15 16:55:27 | 00:06:54
2017-09-15 20:02:22 | 00:06:56
2017-09-15 22:47:11 | 00:06:50
2017-09-16 01:35:19 | 00:07:00
2017-09-16 18:51:03 | 00:06:55
2017-09-17 15:45:25 | 00:06:57
2017-09-17 18:52:27 | 00:06:55
2017-09-18 03:42:24 | 00:06:54
2017-09-18 16:52:17 | 00:06:57
2017-09-18 19:25:26 | 00:06:54
2017-09-19 19:35:33 | 00:06:53
2017-09-19 21:35:33 | 00:06:57
2017-09-19 23:45:32 | 00:06:52
2017-09-20 01:55:32 | 00:06:57
2017-09-20 04:05:34 | 00:06:52
2017-09-20 06:45:37 | 00:06:51
2017-09-20 13:05:14 | 00:06:56
2017-09-20 15:15:30 | 00:06:53
2017-09-20 18:32:43 | 00:06:54
2017-09-21 03:45:17 | 00:06:52
2017-09-21 12:55:13 | 00:06:52
2017-09-22 03:24:55 | 00:06:53
2017-09-22 10:46:46 | 00:06:56
2017-09-22 14:41:52 | 00:06:58
2017-09-22 16:55:29 | 00:06:56
2017-09-22 21:12:51 | 00:06:52
2017-09-22 23:25:27 | 00:06:57
2017-09-23 13:32:13 | 00:06:56
2017-09-23 20:37:31 | 00:06:54
2017-09-24 04:21:47 | 00:06:56
2017-09-24 13:12:21 | 00:06:59
2017-09-24 16:15:17 | 00:06:56
2017-09-25 14:21:13 | 00:06:56
2017-09-25 16:15:30 | 00:06:57
2017-09-26 00:49:52 | 00:06:54
2017-09-26 13:05:26 | 00:06:57
2017-09-26 16:12:29 | 00:06:52
2017-09-26 22:08:19 | 00:06:56
2017-09-27 13:05:10 | 00:06:53
2017-09-27 19:55:11 | 00:06:54
2017-09-28 03:19:24 | 00:06:55
2017-09-28 12:55:11 | 00:06:52
2017-09-28 19:29:51 | 00:06:56
2017-09-29 13:05:20 | 00:06:54
2017-09-29 15:05:27 | 00:06:53
2017-09-29 17:25:27 | 00:06:58
2017-09-29 20:32:42 | 00:06:56
2017-09-29 23:42:47 | 00:06:56
2017-09-30 01:45:29 | 00:06:57
2017-09-30 17:45:29 | 00:06:55
2017-09-30 21:15:22 | 00:06:50
2017-10-01 07:53:00 | 00:06:55
2017-10-01 17:52:42 | 00:06:56
2017-10-01 22:40:24 | 00:06:56
2017-10-02 00:45:31 | 00:06:52
2017-10-02 02:45:29 | 00:06:54
2017-10-02 04:45:30 | 00:06:53
2017-10-03 19:19:44 | 00:06:56
2017-10-03 22:55:23 | 00:06:52
2017-10-04 04:55:20 | 00:06:54
2017-10-04 07:35:19 | 00:06:55
2017-10-04 16:55:13 | 00:06:54
2017-10-04 18:55:22 | 00:06:53
2017-10-05 02:25:12 | 00:06:51
2017-10-05 15:47:54 | 00:06:56
2017-10-05 17:45:26 | 00:06:53
2017-10-05 19:45:24 | 00:06:54
2017-10-06 15:25:26 | 00:07:01
2017-10-07 00:17:40 | 00:07:05
2017-10-07 17:25:17 | 00:07:02
2017-10-07 21:25:19 | 00:07:04
2017-10-07 23:25:26 | 00:07:00
2017-10-08 16:25:18 | 00:07:03
2017-10-08 21:41:18 | 00:07:06
2017-10-08 23:45:27 | 00:07:03
2017-10-09 22:25:16 | 00:07:04
2017-10-10 18:02:04 | 00:07:05
2017-10-10 22:45:21 | 00:07:04
2017-10-11 01:35:27 | 00:07:02
2017-10-11 13:25:20 | 00:07:02
2017-10-11 15:35:12 | 00:07:00
2017-10-12 00:40:31 | 00:07:04
2017-10-12 07:45:34 | 00:07:02
2017-10-12 15:42:25 | 00:07:04
2017-10-12 22:06:06 | 00:07:00
2017-10-13 00:25:29 | 00:07:04
2017-10-13 03:05:15 | 00:06:58
2017-10-13 05:05:28 | 00:06:59
2017-10-13 15:55:19 | 00:06:59
2017-10-13 17:55:28 | 00:07:00
2017-10-13 21:02:40 | 00:07:01
2017-10-13 23:05:28 | 00:06:58
2017-10-14 01:55:29 | 00:06:53
2017-10-14 15:55:20 | 00:06:58
2017-10-14 19:25:22 | 00:06:57
2017-10-14 21:25:29 | 00:06:53
2017-10-16 00:32:52 | 00:06:57
2017-10-16 10:25:14 | 00:06:59
2017-10-16 19:25:11 | 00:06:55
2017-10-16 23:13:01 | 00:06:57
2017-10-19 10:05:17 | 00:07:25
2017-10-19 13:22:19 | 00:07:01
2017-10-20 13:45:22 | 00:06:56
2017-10-20 20:15:13 | 00:06:59
2017-10-21 03:26:09 | 00:07:00
2017-10-22 22:02:19 | 00:07:02
2017-10-23 23:16:54 | 00:06:54
2017-10-24 23:54:30 | 00:07:00
2017-10-25 12:25:12 | 00:07:00
2017-10-26 04:46:44 | 00:06:58
2017-10-26 12:48:47 | 00:07:04
2017-10-26 19:56:59 | 00:06:57
2017-10-26 22:35:26 | 00:06:58
2017-10-27 16:57:43 | 00:06:54
2017-10-28 00:49:08 | 00:07:03
2017-10-28 09:15:20 | 00:06:57
2017-10-28 11:15:29 | 00:06:59
2017-10-28 18:05:22 | 00:06:59
2017-10-29 07:15:19 | 00:06:57
2017-10-29 11:52:03 | 00:07:00
2017-10-30 13:45:26 | 00:06:57
2017-10-30 17:22:00 | 00:06:58
2017-10-31 04:25:11 | 00:07:01
2017-10-31 09:25:21 | 00:07:01
2017-10-31 11:25:28 | 00:06:58
2017-10-31 18:52:45 | 00:07:01
2017-11-01 17:21:21 | 00:07:02
2017-11-01 19:25:24 | 00:07:03
2017-11-01 21:55:24 | 00:07:01
2017-11-02 05:09:30 | 00:07:03
2017-11-02 21:02:00 | 00:06:56
2017-11-03 04:00:49 | 00:07:01
2017-11-03 21:12:03 | 00:07:00
2017-11-03 23:15:32 | 00:06:56
2017-11-04 16:25:21 | 00:06:57
2017-11-05 16:55:15 | 00:06:59
2017-11-05 22:48:10 | 00:07:00
2017-11-06 06:07:42 | 00:06:59
2017-11-06 12:34:03 | 00:06:57
2017-11-06 20:31:33 | 00:07:03
2017-11-07 05:13:21 | 00:06:57
2017-11-07 17:35:21 | 00:07:01
2017-11-08 00:48:49 | 00:07:01
2017-11-08 16:45:09 | 00:07:03
2017-11-09 02:34:30 | 00:06:59
2017-11-09 20:49:29 | 00:07:01
2017-11-09 23:55:46 | 00:07:06
2017-11-10 16:05:14 | 00:07:04
2017-11-10 20:11:45 | 00:07:06
2017-11-11 03:19:14 | 00:07:01
2017-11-11 21:12:52 | 00:07:07
2017-11-12 03:48:53 | 00:07:07
2017-11-13 01:50:37 | 00:07:08
2017-11-13 08:30:09 | 00:07:05
2017-11-13 14:45:25 | 00:07:04
2017-11-13 20:35:14 | 00:07:06
2017-11-13 22:55:34 | 00:07:03
2017-11-14 14:45:28 | 00:07:06
2017-11-14 18:55:17 | 00:07:09
2017-11-14 21:45:34 | 00:07:07
2017-11-15 13:35:13 | 00:07:10
2017-11-15 20:15:26 | 00:07:06
2017-11-16 00:05:26 | 00:07:04
2017-11-16 13:55:15 | 00:07:05
2017-11-16 15:55:25 | 00:07:08
2017-11-16 19:52:49 | 00:07:03
2017-11-17 00:23:19 | 00:07:08
2017-11-17 02:25:28 | 00:07:12
2017-11-17 16:55:15 | 00:07:11
2017-11-17 23:36:06 | 00:07:05
2017-11-18 15:55:20 | 00:07:04
2017-11-18 17:55:31 | 00:07:03
2017-11-18 19:55:29 | 00:07:03
2017-11-19 00:01:57 | 00:07:08
2017-11-20 01:15:12 | 00:07:07
2017-11-20 17:05:08 | 00:07:05
2017-11-20 19:05:21 | 00:07:05
2017-11-20 21:05:12 | 00:07:03
2017-11-21 05:30:00 | 00:07:09
2017-11-21 18:15:17 | 00:07:03
2017-11-22 00:50:01 | 00:07:09
2017-11-22 05:35:12 | 00:07:02
2017-11-22 18:15:13 | 00:07:01
2017-11-22 20:15:13 | 00:07:03
2017-11-22 22:55:12 | 00:07:02
2017-11-23 05:32:01 | 00:07:08
2017-11-23 14:55:21 | 00:07:09
2017-11-23 22:05:02 | 00:07:02
2017-11-24 09:43:02 | 00:07:09
2017-11-24 15:32:18 | 00:07:08
2017-11-24 18:45:04 | 00:07:04
2017-11-24 20:55:05 | 00:07:03
2017-11-25 00:35:06 | 00:07:03
2017-11-25 16:05:05 | 00:07:12
2017-11-25 19:22:39 | 00:07:10
2017-11-26 01:59:53 | 00:07:07
2017-11-26 22:31:21 | 00:07:08
2017-11-27 13:19:12 | 00:07:04
2017-11-28 02:15:38 | 00:07:11
2017-11-28 13:25:16 | 00:07:07
2017-11-28 15:55:14 | 00:07:03
2017-11-28 19:02:24 | 00:07:08
2017-11-28 21:05:22 | 00:07:05
2017-11-29 04:12:19 | 00:07:07
2017-11-29 07:22:21 | 00:07:08
2017-11-29 14:35:14 | 00:07:05
2017-11-29 17:15:14 | 00:07:04
2017-11-29 20:35:03 | 00:07:08
2017-11-29 22:35:14 | 00:07:09
2017-11-30 01:15:14 | 00:07:22
2017-11-30 03:15:15 | 00:07:23
2017-11-30 13:51:09 | 00:07:25
2017-11-30 15:55:16 | 00:07:22
2017-11-30 17:55:22 | 00:07:31
2017-11-30 21:35:05 | 00:07:25
2017-12-01 14:35:08 | 00:07:23
2017-12-01 16:35:17 | 00:07:22
2017-12-01 18:35:18 | 00:07:22
2017-12-01 20:35:18 | 00:07:22
2017-12-02 01:05:11 | 00:07:24
2017-12-02 03:35:16 | 00:07:28
2017-12-03 16:35:11 | 00:07:21
2017-12-04 15:45:06 | 00:07:25
2017-12-04 18:53:20 | 00:07:25
2017-12-04 20:55:19 | 00:07:23
2017-12-05 04:36:22 | 00:07:26
2017-12-05 20:55:19 | 00:07:25
2017-12-06 13:55:11 | 00:07:29
2017-12-06 19:59:09 | 00:07:28
2017-12-07 16:25:09 | 00:07:29
2017-12-08 15:52:37 | 00:07:29
2017-12-08 22:29:47 | 00:07:30
2017-12-09 07:39:10 | 00:07:33
2017-12-09 14:28:56 | 00:07:32
2017-12-09 17:42:43 | 00:07:32
2017-12-10 17:45:08 | 00:07:28
2017-12-11 17:55:05 | 00:07:28
2017-12-12 02:18:43 | 00:07:32
2017-12-12 12:05:08 | 00:07:31
2017-12-12 16:05:09 | 00:07:26
2017-12-13 00:45:09 | 00:07:28
2017-12-13 02:45:23 | 00:07:31
2017-12-13 07:55:12 | 00:07:27
2017-12-13 15:45:07 | 00:07:31
2017-12-13 17:45:14 | 00:07:25
2017-12-13 19:45:15 | 00:07:30
2017-12-13 23:12:21 | 00:07:27
2017-12-14 01:15:16 | 00:07:28
2017-12-14 11:35:06 | 00:07:22
2017-12-14 20:38:08 | 00:07:26
2017-12-14 22:35:16 | 00:07:27
2017-12-15 08:43:02 | 00:07:24
2017-12-16 16:35:03 | 00:07:24
2017-12-16 19:42:20 | 00:07:27
2017-12-16 21:45:18 | 00:07:23
2017-12-17 05:45:11 | 00:07:24
2017-12-17 16:55:14 | 00:07:26
2017-12-18 10:35:09 | 00:07:20
2017-12-18 17:35:06 | 00:07:23
2017-12-18 21:42:36 | 00:07:26
2017-12-18 23:45:21 | 00:07:24
2017-12-19 15:25:09 | 00:07:27
2017-12-19 17:25:22 | 00:07:21
2017-12-19 20:32:32 | 00:07:39
2017-12-20 23:42:47 | 00:07:38
2017-12-21 18:25:17 | 00:08:00
2017-12-21 22:25:09 | 00:07:59
2017-12-22 10:35:05 | 00:08:01
2017-12-23 04:59:41 | 00:08:01
2017-12-24 11:05:07 | 00:12:55
2017-12-25 16:05:08 | 00:08:05
2017-12-26 17:45:17 | 00:08:06
2017-12-27 16:43:39 | 00:08:00
2017-12-27 18:55:04 | 00:08:05
2017-12-27 20:55:16 | 00:08:09
2017-12-27 22:55:15 | 00:08:05
2017-12-28 11:25:11 | 00:08:14
2017-12-29 13:45:17 | 00:08:08
2017-12-29 16:52:35 | 00:08:03
2017-12-29 20:55:09 | 00:08:08
2017-12-29 23:15:16 | 00:08:10
2017-12-31 22:25:05 | 00:08:09
2018-01-01 08:22:49 | 00:08:03
2018-01-01 22:45:05 | 00:08:06
2018-01-02 17:35:08 | 00:08:07
2018-01-03 06:21:19 | 00:08:32
2018-01-03 17:22:08 | 00:08:01
2018-01-03 19:35:15 | 00:08:07
2018-01-04 02:10:40 | 00:08:04
2018-01-04 06:15:08 | 00:08:05
2018-01-04 13:05:10 | 00:08:07
2018-01-04 15:55:09 | 00:08:06
2018-01-05 00:15:11 | 00:08:02
2018-01-05 19:32:45 | 00:08:03
2018-01-06 01:29:11 | 00:08:03
2018-01-06 04:52:40 | 00:08:04
2018-01-06 11:55:08 | 00:08:07
2018-01-06 14:05:19 | 00:07:58
2018-01-08 01:45:05 | 00:08:03
2018-01-08 23:35:08 | 00:08:02
2018-01-09 04:52:44 | 00:08:04
2018-01-09 14:55:09 | 00:08:01
2018-01-09 18:12:45 | 00:08:05
2018-01-10 01:27:23 | 00:08:00
2018-01-10 08:35:12 | 00:08:04
2018-01-10 14:35:00 | 00:08:06
2018-01-10 16:45:15 | 00:08:00
2018-01-10 23:03:37 | 00:08:07
2018-01-11 14:02:53 | 00:08:03
2018-01-11 17:05:10 | 00:08:03
2018-01-11 19:15:18 | 00:08:04
2018-01-12 02:55:15 | 00:08:01
2018-01-12 14:25:08 | 00:08:04
2018-01-12 17:15:18 | 00:08:02
2018-01-12 22:31:40 | 00:08:03
2018-01-13 14:05:07 | 00:08:04
2018-01-16 23:15:16 | 00:08:01
2018-01-17 01:25:20 | 00:08:03
2018-01-17 08:35:12 | 00:08:00
2018-01-17 11:45:15 | 00:08:00
2018-01-17 19:55:05 | 00:08:01
2018-01-18 00:23:00 | 00:07:58
2018-01-18 19:25:10 | 00:08:04
2018-01-19 00:45:04 | 00:08:06
2018-01-19 06:45:05 | 00:08:28
2018-01-19 12:55:06 | 00:08:03
2018-01-19 20:35:10 | 00:08:11
2018-01-19 23:05:17 | 00:08:19
2018-01-20 03:25:06 | 00:08:12
2018-01-20 13:15:15 | 00:08:15
2018-01-21 13:53:06 | 00:08:12
2018-01-21 16:05:21 | 00:08:12
2018-01-22 21:58:09 | 00:08:16
2018-01-23 12:15:10 | 00:08:11
2018-01-23 16:05:03 | 00:08:09
(4037 rows)
Вложения
On Wed, Jan 24, 2018 at 12:10 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote: > There is a very clear secular trend up in the longer data series, > which indicates that we're testing more stuff, +1 > which doesn't bother > me in itself as long as the time is well spent. However, the trend > over the last two months is very bad, and I do not think that we can > point to any large improvement in test coverage that someone committed > since November. I'm not sure if coverage.postgresql.org has a way to view historical reports so we can see the actual percentage change, but as I recall it, commit fa330f9ad "Add some regression tests that exercise hash join code." pushed nodeHash.c and possibly nodeHashJoin.c into green territory on here: https://coverage.postgresql.org/src/backend/executor/index.html > Looking more closely at the shorter series, there are four pretty obvious > step changes since 2016-09. The PNG's x-axis doesn't have enough > resolution to match these up to commits, but looking at the underlying > data, they clearly correspond to: > > Branch: master Release: REL_10_BR [b801e1200] 2016-10-18 15:57:58 -0400 > Improve regression test coverage for hash indexes. > > Branch: master Release: REL_10_BR [4a8bc39b0] 2017-04-12 16:17:53 -0400 > Speed up hash_index regression test. > > Branch: master [fa330f9ad] 2017-11-29 16:06:50 -0800 > Add some regression tests that exercise hash join code. Joining check runtimes with the commit log (see attached), I see: 2017-11-30 | fa330f9a | Add some regression tests that exercise | 00:08:30 2017-11-29 | 84940644 | New C function: bms_add_range | 00:08:18 That's +2.4%. > Branch: master [180428404] 2017-12-21 00:43:41 -0800 > Add parallel-aware hash joins. 2017-12-21 | cce1ecfc | Adjust assertion in GetCurrentCommandId. | 00:09:03 2017-12-21 | 6719b238 | Rearrange execution of PARAM_EXTERN Para | 2017-12-21 | 8a0596cb | Get rid of copy_partition_key | 2017-12-21 | 9ef6aba1 | Fix typo | 2017-12-21 | c98c35cd | Avoid putting build-location-dependent s | 2017-12-21 | 59d1e2b9 | Cancel CV sleep during subtransaction ab | 2017-12-21 | 18042840 | Add parallel-aware hash joins. | 2017-12-20 | f94eec49 | When passing query strings to workers, p | 00:08:45 That's +3.4%. That's a bit more than I expected. I saw 2.5% on my development box and hoped that'd be OK for a complex feature with a lot of paths to test. But hang on a minute -- how did we get to 08:45 from 08:30 between those commits? Of course this is all noisy data and individual samples are all over the place, but I think I see some signal here: 2017-12-20 | f94eec49 | When passing query strings to workers, p | 00:08:45 2017-12-19 | 7d3583ad | Test instrumentation of Hash nodes with | 00:08:43 2017-12-19 | 8526bcb2 | Try again to fix accumulation of paralle | 2017-12-19 | 38fc5470 | Re-fix wrong costing of Sort under Gathe | 00:08:31 2017-12-19 | 09a65f5a | Mark a few parallelism-related variables | 00:08:27 Both 8526bcb2 and 7d3583ad add Gather rescans. Doesn't 8526bcb2 add a query that forks 40 times? I wonder how long it takes to start a background worker on a Mac Cube. From that commit: + -> Gather (actual rows=9800 loops=10) + Workers Planned: 4 + Workers Launched: 4 + -> Parallel Seq Scan on tenk1 (actual rows=1960 loops=50) > I thought that the hash index test case was excessively expensive for > what it covered, and I'm now thinking the same about hash joins. Does join-test-shrink.patch (from my earlier message) help much, on prairiedog? It cut "check" time by ~1.5% on my low end machine. -- Thomas Munro http://www.enterprisedb.com
Вложения
On Tue, Jan 23, 2018 at 6:10 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote: > Looking more closely at the shorter series, there are four pretty obvious > step changes since 2016-09. The PNG's x-axis doesn't have enough > resolution to match these up to commits, but looking at the underlying > data, they clearly correspond to: > > Branch: master Release: REL_10_BR [b801e1200] 2016-10-18 15:57:58 -0400 > Improve regression test coverage for hash indexes. > > Branch: master Release: REL_10_BR [4a8bc39b0] 2017-04-12 16:17:53 -0400 > Speed up hash_index regression test. > > Branch: master [fa330f9ad] 2017-11-29 16:06:50 -0800 > Add some regression tests that exercise hash join code. > > Branch: master [180428404] 2017-12-21 00:43:41 -0800 > Add parallel-aware hash joins. > > I thought that the hash index test case was excessively expensive for > what it covered, and I'm now thinking the same about hash joins. Hmm. I guess I'm insulated from some of the problem here by my choice of hardware. On my laptop, 'make check' takes between 25.5 and 26 seconds (on 28e04155f17cabda7a18aee31d130aa10e25ee86). If I remove the hash_index test from parallel_schedule, it still takes between 25.5 and 26 seconds. If I also remove the join test in its entirety, it drops down to 24-24.5 seconds. If I put hash_index and join back in the schedule file but revert join.sql and join.out to the version just before fa330f9ad, it takes about 24.5 seconds. So for me, the additional hash index tests don't cost anything measurable and the additional hash join tests cost about a second. I think this probably accounts for why committers other than you keep "adding so much time to the regression tests". On modern hardware, the costs just don't matter. As a further point of reference, on this machine, 9.5 stable is 24.5-25 seconds, and 9.3 is 25.5-26 seconds, so from here it looks like in the last 5 years the speed of 'make check' is within a half second or so of the performance we had 5 years ago even though the volume of the regression tests in terms of lines of SQL code has increased by more than 50% in the same time period. Now, how much should we care about the performance of software with a planned release date of 2018 on hardware discontinued in 2001, hardware that is apparently about 20 times slower than a modern laptop? Some, perhaps, but maybe not a whole lot. Removing tests that have found actual bugs because they cost runtime on ancient systems that nobody uses for serious work doesn't make sense to me. -- Robert Haas EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company
On 2018-01-23 14:24:56 -0500, Robert Haas wrote: > Right, but this doesn't seem to show any big spike in the runtime at > the time when parallel hash was committed, or when the preparatory > patch to add test coverage for hash joins got committed. Rather, > there's a gradual increase over time. Either we're making the server > slower (which would be bad) or we're adding proper test coverage for > all the new features that we're adding (which would be good). We > can't expect every feature patch to preserve the runtime of the tests > absolutely unchanged; figuring out what can be optimized is a separate > exercise from adding test coverage either for new things or for things > that weren't previously covered. Agreed. One the improvement front, my observation is that we rarely are actually cpu bound across processes. One thing I've been wondering is whether we can get a pretty large win from just rescheduling parallel_schedule. There definitely are individual testfiles that take a lot longer than others, but their positining in groups doesn't necessarily reflect that. Besides manually reordering the schedule, I think it might be time that we improve pg_regress's scheduling. One big first step would e.g. be to not manually limit the number of parallel tests in a group to 20, but instead allow larger groups and only run a limited number of them in parallel. If done right we could start the next test in a group as soon as *one* task in a group has finished, rather than waiting for all of them to finish as we currently do for (sub-)groups. Besides larger groups, starting the next test(s) earlier, another way to gain pretty large improvements would be a test schedule feature that allowed to stat dependencies between tests. So instead of manually grouping the schedule, have 'numerology' state that it depends on int2, int4, int8, float4, float8, which means it can actually be started earlier than it currently can in many cases. Greetings, Andres Freund
Hi, On 2018-01-24 13:11:22 -0500, Robert Haas wrote: > So for me, the additional hash index tests don't cost anything > measurable and the additional hash join tests cost about a second. I > think this probably accounts for why committers other than you keep > "adding so much time to the regression tests". On modern hardware, > the costs just don't matter. I very much agree with the general sentiment, but a second of a 25s test certainly isn't nothing. As I've just written a few messages upthread, I think we can hide the overall timing costs to a much larger degree than we're doing, but I don't think we need not pay attention at all. > Now, how much should we care about the performance of software with a > planned release date of 2018 on hardware discontinued in 2001, > hardware that is apparently about 20 times slower than a modern > laptop? Some, perhaps, but maybe not a whole lot. Removing tests > that have found actual bugs because they cost runtime on ancient > systems that nobody uses for serious work doesn't make sense to me. I again agree with the sentiment. One caveat is that old machines also somewhat approximate testing with more instrumentation / debugging enabled (say valgrind, CLOBBER_CACHE_ALWAYS, etc). So removing excessive test overhead has still quite some benefits. But I definitely do not want to lower coverage to achieve it. Greetings, Andres Freund
Andres Freund <andres@anarazel.de> writes:
> On 2018-01-24 13:11:22 -0500, Robert Haas wrote:
>> Now, how much should we care about the performance of software with a
>> planned release date of 2018 on hardware discontinued in 2001,
>> hardware that is apparently about 20 times slower than a modern
>> laptop? Some, perhaps, but maybe not a whole lot. Removing tests
>> that have found actual bugs because they cost runtime on ancient
>> systems that nobody uses for serious work doesn't make sense to me.
> I again agree with the sentiment.
I find that to be a completely bogus straw-man argument. The point of
looking at the prairiedog time series is just to see a data series in
which the noise level is small enough to discern the signal. If anyone's
got years worth of data off a more modern machine, and they can extract
a signal from that, by all means let's consider that data instead. But
there's no clear argument (or at least you have not made one) that says
that prairiedog's relative timings don't match what we'd get on more
modern machines.
Now, what *is* a relevant objection is that most of us care more about
the runtime of the parallelized regression tests than serial tests.
I did not use prairiedog's "make check" timings in these graphs because
that would include "make install" and initdb timings, adding noise and
overhead and probably making it harder to see what's going on. But
it's perfectly fair to want to optimize that case not the serial case.
However ... if you spend any time looking at the behavior of that,
the hashjoin tests are still problematic. I instrumented the parallel
tests by turning on log_disconnections so as to get per-test-script
timings, and what I find to be the slowest steps on my development
workstation are
[pg_regress/rowsecurity] 0.517
[pg_regress/partition_join] 0.535
[pg_regress/updatable_views] 0.546
[pg_regress/stats] 0.566
[pg_regress/triggers] 0.618
[pg_regress/foreign_data] 0.642
[pg_regress/stats_ext] 0.670
[pg_regress/select_parallel] 0.828
[pg_regress/create_index] 0.916
[pg_regress/alter_table] 1.187
[pg_regress/gist] 1.283
[pg_regress/join] 1.923
[pg_regress/plpgsql] 3.100
(The overall runtime for "make installcheck-parallel" on this machine
is about 17.3 seconds right now.) The next slowest test script in
the join test's group is "update", at 0.373 seconds; so over 1.5 sec
of the total 17.3 sec runtime is being spent solely in the join script.
Running the same test on the v10 branch, the slowest steps are
[pg_regress/join] 0.521
[pg_regress/rowsecurity] 0.521
[pg_regress/updatable_views] 0.554
[pg_regress/triggers] 0.624
[pg_regress/foreign_data] 0.647
[pg_regress/stats_ext] 0.675
[pg_regress/select_parallel] 0.690
[pg_regress/create_index] 0.928
[pg_regress/gist] 1.020
[pg_regress/alter_table] 1.120
[pg_regress/plpgsql] 3.217
so join has gotten about 1 second slower since v10, and that time is
coming entirely out of developers' hides despite parallelism because
it was already the slowest in its group.
So I continue to maintain that an unreasonable fraction of the total
resources devoted to the regular regression tests is going into these
new hashjoin tests.
Based on these numbers, it seems like one easy thing we could do to
reduce parallel check time is to split the plpgsql test into several
scripts that could run in parallel. But independently of that,
I think we need to make an effort to push hashjoin's time back down.
> One caveat is that old machines also
> somewhat approximate testing with more instrumentation / debugging
> enabled (say valgrind, CLOBBER_CACHE_ALWAYS, etc). So removing excessive
> test overhead has still quite some benefits. But I definitely do not
> want to lower coverage to achieve it.
I don't want to lower coverage either. I do want some effort to be
spent on achieving test coverage intelligently, rather than just throwing
large test cases at the code without consideration of the costs.
regards, tom lane
I wrote:
> I find that to be a completely bogus straw-man argument. The point of
> looking at the prairiedog time series is just to see a data series in
> which the noise level is small enough to discern the signal. If anyone's
> got years worth of data off a more modern machine, and they can extract
> a signal from that, by all means let's consider that data instead.
Just to make the point, I scraped the numbers for skink's "installcheck"
and "check" steps, which are data series I imagine at least Andres will
concede are worth paying attention to. I made no attempt to clean
outliers, so these curves are pretty noisy, but I think there is a very
clear upward bump since mid-December.
regards, tom lane
Вложения
Hi, On 2018-01-24 14:31:47 -0500, Tom Lane wrote: > However ... if you spend any time looking at the behavior of that, > the hashjoin tests are still problematic. I think my main problem with your arguments is that you basically seem to say that one of the more complex features in postgres can't increase the test time. And I just don't agree with that. If we can reduce some unnecessary overhead (as Thomas iirc has done somwhere nearby) - great, if we can hide the overhead by scheduling the test better or breaking it up - also great. But if that's a good chunk of work I think it's entirely reasonable to not necessarily consider that the best use of time. It doesn't seem too surprising that a test that relies on starting multiple background processes in multiple places will be among the more expensive ones. We clearly would e.g. benefit from being able to reuse workers, to avoid constantly starting/stopping them. > (The overall runtime for "make installcheck-parallel" on this machine > is about 17.3 seconds right now.) The next slowest test script in > the join test's group is "update", at 0.373 seconds; so over 1.5 sec > of the total 17.3 sec runtime is being spent solely in the join script. Might be worth breaking up join a bit, that won't get rid of all the wall time overhead, but should reduce it. Reordering to run parallel to other slow tests might also be worthwhile. > So I continue to maintain that an unreasonable fraction of the total > resources devoted to the regular regression tests is going into these > new hashjoin tests. > > One caveat is that old machines also > > somewhat approximate testing with more instrumentation / debugging > > enabled (say valgrind, CLOBBER_CACHE_ALWAYS, etc). So removing excessive > > test overhead has still quite some benefits. But I definitely do not > > want to lower coverage to achieve it. > > I don't want to lower coverage either. I do want some effort to be > spent on achieving test coverage intelligently, rather than just throwing > large test cases at the code without consideration of the costs. I think this accusation is unfair. Are you really suggesting that nobody else cares about the runtime of the new tests? Just because other people's tradeoffs come down at a somewhat different place, doesn't mean they add tests "without consideration of the costs". > Based on these numbers, it seems like one easy thing we could do to > reduce parallel check time is to split the plpgsql test into several > scripts that could run in parallel. But independently of that, > I think we need to make an effort to push hashjoin's time back down. If we had a dependency based system as I suggested nearby, we could have pg_regress order the tests so that the slowest ones that have dependencies fulfilled are started first... Greetings, Andres Freund
Andres Freund wrote: > Besides larger groups, starting the next test(s) earlier, another way to > gain pretty large improvements would be a test schedule feature that > allowed to stat dependencies between tests. So instead of manually > grouping the schedule, have 'numerology' state that it depends on int2, > int4, int8, float4, float8, which means it can actually be started > earlier than it currently can in many cases. Yeah, I proposed this a decade ago but never had the wits to write the code. It would be very useful for running tests standalone, too -- much as I dislike 'make installcheck' taking half a minute, I dislike much more having to take 5 minutes each time to figure out that create_table depends on box, polygon, create_function, yadda yadda. -- Álvaro Herrera https://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
Thomas Munro wrote: > On Wed, Jan 24, 2018 at 12:10 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote: > > However, the trend over the last two months is very bad, and I do > > not think that we can point to any large improvement in test > > coverage that someone committed since November. > > I'm not sure if coverage.postgresql.org has a way to view historical > reports so we can see the actual percentage change, It does not. I have had that in my to-do list for a while, but haven't gotten around to it. -- Álvaro Herrera https://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
Alvaro Herrera <alvherre@alvh.no-ip.org> writes:
> Andres Freund wrote:
>> Besides larger groups, starting the next test(s) earlier, another way to
>> gain pretty large improvements would be a test schedule feature that
>> allowed to stat dependencies between tests. So instead of manually
>> grouping the schedule, have 'numerology' state that it depends on int2,
>> int4, int8, float4, float8, which means it can actually be started
>> earlier than it currently can in many cases.
> Yeah, I proposed this a decade ago but never had the wits to write the
> code.
There'd be a lot of followup work to sanitize the tests better. For
instance, if two tests transiently create tables named "foo", it doesn't
matter as long as they're not in the same group. It would matter with
this.
There are things we could do to mitigate that --- one attractive idea
is to have each test create its own schema for transient objects.
The limiting factor is that we don't want the test scripts to change
so much that back-patching tests becomes impossible. (Or at least,
I'd not like that.)
I'm concerned that we'd end up with a higher number of irreproducible
test failures with no good way to investigate them.
> It would be very useful for running tests standalone, too -- much as I
> dislike 'make installcheck' taking half a minute, I dislike much more
> having to take 5 minutes each time to figure out that create_table
> depends on box, polygon, create_function, yadda yadda.
Yeah, if we could say "run just this test and its needed precursors",
that'd be a huge win in a lot of situations.
Definitely seems like an idea worth pursuing.
regards, tom lane
Hi, On 2018-01-24 17:18:26 -0300, Alvaro Herrera wrote: > Andres Freund wrote: > > Besides larger groups, starting the next test(s) earlier, another way to > > gain pretty large improvements would be a test schedule feature that > > allowed to stat dependencies between tests. So instead of manually > > grouping the schedule, have 'numerology' state that it depends on int2, > > int4, int8, float4, float8, which means it can actually be started > > earlier than it currently can in many cases. > > Yeah, I proposed this a decade ago but never had the wits to write the > code. It shouldn't be too hard, right? Leaving defining the file format, parsing it, creating the new schedule with depencencies and adapting tests aside (hah), it mostly seems a relatively simple graph ordering / topological sort problem, right? If we keep the timings from an earlier run somwhere, we can use the timing of runs as edge weights, making the schedule better. > It would be very useful for running tests standalone, too -- much as I > dislike 'make installcheck' taking half a minute, I dislike much more > having to take 5 minutes each time to figure out that create_table > depends on box, polygon, create_function, yadda yadda. Oh, that's a good point. - Andres
Hi, On 2018-01-24 15:36:35 -0500, Tom Lane wrote: > There'd be a lot of followup work to sanitize the tests better. For > instance, if two tests transiently create tables named "foo", it doesn't > matter as long as they're not in the same group. It would matter with > this. Right. I suspect we'd initially end up with a schedule that'd had dependencies pretty similar to what we have now as groups. I suspect that even with a very small number of changes we'd get a lot better timings. > There are things we could do to mitigate that --- one attractive idea > is to have each test create its own schema for transient objects. > The limiting factor is that we don't want the test scripts to change > so much that back-patching tests becomes impossible. (Or at least, > I'd not like that.) I think a lot of temporary, potentially conflicting, objects are already created as TEMPORARY. Adding a few more temporary markers shouldn't be too hard. > I'm concerned that we'd end up with a higher number of irreproducible > test failures with no good way to investigate them. Hm. We probably should dump the used ordering of tests somwhere upon failure, to make it easier to debug. Greetings, Andres Freund
Andres Freund <andres@anarazel.de> writes:
> On 2018-01-24 17:18:26 -0300, Alvaro Herrera wrote:
>> Yeah, I proposed this a decade ago but never had the wits to write the
>> code.
> It shouldn't be too hard, right? Leaving defining the file format,
> parsing it, creating the new schedule with depencencies and adapting
> tests aside (hah), it mostly seems a relatively simple graph ordering /
> topological sort problem, right?
Yeah. We already have topo sort code in pg_dump, maybe we could push that
into someplace like src/common or src/fe_utils? Although pg_dump hasn't
got any need for edge weights, so maybe sharing code isn't worth it.
We could flush the existing schedule files and use a simple format like
testname: list of earlier tests it depends on
(I guess there would be more properties than just the dependencies,
but still not hard to parse.)
> If we keep the timings from an earlier
> run somwhere, we can use the timing of runs as edge weights, making the
> schedule better.
I think we could just use constant values hand-coded in the schedule file.
It might occasionally be worth updating them, but realistically it's not
going to matter that they be very accurate. Probably weights like 1, 2,
and 3 would be plenty ;-)
regards, tom lane
Andres Freund <andres@anarazel.de> writes:
> On 2018-01-24 15:36:35 -0500, Tom Lane wrote:
>> I'm concerned that we'd end up with a higher number of irreproducible
>> test failures with no good way to investigate them.
> Hm. We probably should dump the used ordering of tests somwhere upon
> failure, to make it easier to debug.
The progress-display output of pg_regress would need a complete rethink
anyhow. First thought is to emit two lines per test, one when we
launch it and one when it finishes and we check the results:
foreign_data: launched
...
foreign_data: ok (or FAILED)
regards, tom lane
Hi, On 2018-01-24 15:58:16 -0500, Tom Lane wrote: > Yeah. We already have topo sort code in pg_dump, maybe we could push that > into someplace like src/common or src/fe_utils? Although pg_dump hasn't > got any need for edge weights, so maybe sharing code isn't worth it. I suspect it may be more work to share than worth it, but either way, it shouldn't be too hard. Hm, isn't dbObjectTypePriority kinda an edge weight? Seems like we properly could implement it as that. > We could flush the existing schedule files and use a simple format like > testname: list of earlier tests it depends on > (I guess there would be more properties than just the dependencies, > but still not hard to parse.) Yea, I think there'd need to be a few more. There's some tests that use multiple connections, and I suspect it'll be useful to have "implicit" ordering dependencies for a few test, like a "barrier". Otherwise e.g. the tablespace test will be annoying to order. > > If we keep the timings from an earlier > > run somwhere, we can use the timing of runs as edge weights, making the > > schedule better. > > I think we could just use constant values hand-coded in the schedule file. > It might occasionally be worth updating them, but realistically it's not > going to matter that they be very accurate. Probably weights like 1, 2, > and 3 would be plenty ;-) The reason I like the idea of using prior tests as scheduling input is that the slowness actually depends a lot on the type of machine its run on, and more importantly on things like valgrind, CCA, fsync=on/off, jit=on/off (far most expensive tests is e.g. the recursion test in errors.sql :)). Greetings, Andres Freund
On Wed, Jan 24, 2018 at 2:31 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote: > I find that to be a completely bogus straw-man argument. The point of > looking at the prairiedog time series is just to see a data series in > which the noise level is small enough to discern the signal. If anyone's > got years worth of data off a more modern machine, and they can extract > a signal from that, by all means let's consider that data instead. But > there's no clear argument (or at least you have not made one) that says > that prairiedog's relative timings don't match what we'd get on more > modern machines. There is no need to collect years of data in order to tell whether or not the time to run the tests has increased by as much on developer machines as it has on prairiedog. You showed the time going from 3:36 to 8:09 between 2014 and the present. That is a 2.26x increase. It is obvious from the numbers I posted before that no such increase has taken place in the time it takes to run 'make check' on my relatively modern laptop. Whatever difference exists is measured in milliseconds. > so join has gotten about 1 second slower since v10, and that time is > coming entirely out of developers' hides despite parallelism because > it was already the slowest in its group. > > So I continue to maintain that an unreasonable fraction of the total > resources devoted to the regular regression tests is going into these > new hashjoin tests. I think there is an affirmative desire on the part of many contributors to have newer features tested more thoroughly than old ones were. That will tend to mean that features added more recently have test suites that are longer-running compared to the value of the feature they test than what we had in the past. When this has been discussed at developer meetings, everyone except you (and to a lesser extent me) has been in favor of this. Even if that meant that you had to wait 1 extra second every time you run 'make check', I would judge that worthwhile. But it probably doesn't, because there are a lot of things that can be done to improve this situation, such as... > Based on these numbers, it seems like one easy thing we could do to > reduce parallel check time is to split the plpgsql test into several > scripts that could run in parallel. But independently of that, > I think we need to make an effort to push hashjoin's time back down. ...this. Also, the same technique could probably be applied to the join test itself. I think Thomas just added the tests to that file because it already existed, but there's nothing to say that the file couldn't be split into several chunks. On a quick look, it looks to me as though that file is testing a lot of pretty different things, and it's one of the largest test case files, accounting for ~3% of the total test suite by itself. Another thing you could do is consider applying the patch Thomas already posted to reduce the size of the tables involved. The problem is that, for you and the buildfarm to be happy, the tests have to (1) run near-instantaneously even on thoroughly obsolete hardware, (2) give exactly the same answers on 32-bit systems, 64-bit systems, Linux, Windows, AIX, HP-UX, etc., and (3) give those same exact answers 100% deterministically on all of those platforms. Parallel query is inherently non-deterministic about things like how much work goes to each worker, and I think that really small tests will tend to show more edge cases like one worker not doing anything. So it might be that if we cut down the sizes of the test cases we'll spend more time troubleshooting the resulting instability than any developer time we would've saved by reducing the runtime. But we can try it. >> One caveat is that old machines also >> somewhat approximate testing with more instrumentation / debugging >> enabled (say valgrind, CLOBBER_CACHE_ALWAYS, etc). So removing excessive >> test overhead has still quite some benefits. But I definitely do not >> want to lower coverage to achieve it. > > I don't want to lower coverage either. I do want some effort to be > spent on achieving test coverage intelligently, rather than just throwing > large test cases at the code without consideration of the costs. I don't believe that any such thing is occurring, and I think it's wrong of you to imply that these test cases were added unintelligently. To me, that seems like an ad hominum attack on both Thomas (who spent a year or more developing the feature those test cases exercise) and Andres (who committed them). -- Robert Haas EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company
On Wed, Jan 24, 2018 at 4:01 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote: > The progress-display output of pg_regress would need a complete rethink > anyhow. First thought is to emit two lines per test, one when we > launch it and one when it finishes and we check the results: > > foreign_data: launched > ... > foreign_data: ok (or FAILED) I suspect that first line would only be interesting on the very rare occasions when test hangs. I'm not sure it would be good to add that much chatter. -- Robert Haas EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company
Robert Haas <robertmhaas@gmail.com> writes:
> There is no need to collect years of data in order to tell whether or
> not the time to run the tests has increased by as much on developer
> machines as it has on prairiedog. You showed the time going from 3:36
> to 8:09 between 2014 and the present. That is a 2.26x increase. It
> is obvious from the numbers I posted before that no such increase has
> taken place in the time it takes to run 'make check' on my relatively
> modern laptop. Whatever difference exists is measured in
> milliseconds.
I may be wasting my breath here, but in one more attempt to convince
you that "time make check" on your laptop is not the only number that
anyone should be interested in, here are some timings off my development
workstation. These are timings off current tip of each release branch,
all the same build options etc, so very comparable:
9.4
[ don't remember the equivalent to top-level make temp-install here ]
top-level make check 24.725s
installcheck-parallel 15.383s
installcheck 27.560s
9.5
make temp-install 3.702s
initdb 2.328s
top-level make check 24.709s
installcheck-parallel 16.632s
installcheck 32.427s
9.6
make temp-install 3.971s
initdb 2.178s
top-level make check 24.048s
installcheck-parallel 15.889s
installcheck 32.775s
10
make temp-install 4.051s
initdb 1.363s
top-level make check 21.784s
installcheck-parallel 15.209s
installcheck 31.938s
HEAD
make temp-install 4.048s
initdb 1.361s
top-level make check 24.027s
installcheck-parallel 16.914s
installcheck 35.745s
I copied-and-pasted the "real time" results of time(1) for each of these,
not bothering to round them off; but the numbers are only reproducible
to half a second or so, so there's no significance in the last couple
digits. Most numbers above are the minimum of 2 or more runs.
What I take away here is that there's been a pretty steep cost increase
for the regression tests since v10, and that is *not* in line with the
historical average. In fact, in most years we've bought enough speedup
through performance improvements to pay for the test cases we added.
This is masked if you just eyeball "make check" compared to several years
ago. But to do that, you have to ignore the fact that we made substantial
improvements in the runtime of initdb as well as the regression tests
proper circa v10, and we've now thrown that away and more.
So I remain dissatisfied with these results, particularly because in
my own work habits, the time for "make installcheck-parallel" is way
more interesting than "make check". I avoid redoing installs and
initdbs if I don't need them.
> ... Even if that meant that you had
> to wait 1 extra second every time you run 'make check', I would judge
> that worthwhile.
I think this is a bad way of looking at it. Sure, in terms of
one developer doing one test run, a second or two means nothing.
But for instance, if you want to do 100 test runs in hope of catching
a seldom-reproduced bug, it adds up. It also adds up when you consider
the aggregate effort expended by the buildfarm, or the time you have
to wait to see buildfarm results.
> Another thing you could do is consider applying the patch Thomas
> already posted to reduce the size of the tables involved.
Yeah. What I thought this argument was about was convincing *you*
that that would be a reasonable patch to apply. It seems from my
experiment on gaur that that patch makes the results unstable, so
if we can do it at all it will need more work. But I do think
it's worth putting in some more sweat here. In the long run the
time savings will add up.
regards, tom lane
On Wed, Jan 24, 2018 at 11:02 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote: > I may be wasting my breath here, but in one more attempt to convince > you that "time make check" on your laptop is not the only number that > anyone should be interested in, ... Now that is not what I said, or at least not what I intended to say. I'm taking the position that what happens on a developer laptop is more relevant than what happens on an ancient buildfarm critter. I am NOT taking the position that my particular laptop or even developer laptops generally are the *only* thing that matters. I gave the numbers from my laptop because it's the one I can test. I cannot easily test yours. > What I take away here is that there's been a pretty steep cost increase > for the regression tests since v10, and that is *not* in line with the > historical average. In fact, in most years we've bought enough speedup > through performance improvements to pay for the test cases we added. > This is masked if you just eyeball "make check" compared to several years > ago. But to do that, you have to ignore the fact that we made substantial > improvements in the runtime of initdb as well as the regression tests > proper circa v10, and we've now thrown that away and more. OK, I can see some increase there. It's definitely more for you than it is for me, since you see something like a 10% slowdown between 10 and master and I see basically no difference. I don't know why that should be, but I'm not doubting you. > So I remain dissatisfied with these results, particularly because in > my own work habits, the time for "make installcheck-parallel" is way > more interesting than "make check". I avoid redoing installs and > initdbs if I don't need them. I'm not that efficient, but noted. >> ... Even if that meant that you had >> to wait 1 extra second every time you run 'make check', I would judge >> that worthwhile. > > I think this is a bad way of looking at it. Sure, in terms of > one developer doing one test run, a second or two means nothing. > But for instance, if you want to do 100 test runs in hope of catching > a seldom-reproduced bug, it adds up. It also adds up when you consider > the aggregate effort expended by the buildfarm, or the time you have > to wait to see buildfarm results. Sure, but as Andres said, you also have to consider how much developer time it takes to recoup the savings. If it takes a day of development time to save a second of regression test time, that might be worth it; if it takes a month, color me doubtful, especially if the result is a more fragile test that happens to pass on all of the buildfarm critters we have now but might fail spuriously when somebody adds a new one. > Yeah. What I thought this argument was about was convincing *you* > that that would be a reasonable patch to apply. It seems from my > experiment on gaur that that patch makes the results unstable, so > if we can do it at all it will need more work. But I do think > it's worth putting in some more sweat here. In the long run the > time savings will add up. Why me? Thomas wrote the patch, Andres committed it, and you complained about it. I'm just along for the ride. -- Robert Haas EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company